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The  main  purpose  of  this  dissertation  is  to  formulate  methods  for  representing  the 
efficient  set  of  a  multiple  objective  mathematical  programming  problem  by  a  discrete 
sample  of  points.  Finding  adequate  representations  of  efficient  sets  is  an  important 
problem  in  multiple  objective  decision  making.  A  good  representation  of  an  efficient  set 
should  consist  of  a  well-dispersed  set  of  points  that  portrays  the  entire  set.  We  present 
various  algorithms  and  algorithmic  ideas  that  would  contribute  to  finding  such 
representations  with  a  reasonable  amount  of  computational  effort. 

Solving  the  problem  of  optimizing  a  linear  function  over  the  efficient  set  of  a 
multiple  objective  linear  program  can  contribute  towards  the  construction  of  discrete 
representations  of  efficient  sets.  While  certain  exact  and  heuristic  procedures  for  solving 
this  problem  have  been  proposed,  improved  methods  are  needed.   Towards  this  end,  we 
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propose  a  finite  algonthm  for  concave  minimization  over  a  polyhedron  which  can  be  used 
as  a  subroutine  in  a  recently-proposed  exact  algorithm  for  optimizing  over  the  efficient 
set.  The  concave  minimization  algorithm  uses  branch  and  bound  and  a  new  idea  that  we 
call  "neighbor  generation."  We  also  study  some  special  cases  of  optimizing  a  linear 
function  over  an  efficient  set,  and  we  provide  detection  and  solution  procedures  for  these 
special  cases.  To  solve  the  problem,  we  develop  a  face  search  heuristic  algorithm  which 
samples  among  the  efficient  faces  of  the  feasible  region  and  optimizes  the  objective 
function  over  each  efficient  face  that  is  found. 

To  develop  a  direct  approach  for  finding  a  discrete  representation  of  the  efficient 
set,  we  introduce  the  "shooting"  idea.  This  is  a  global  approach  and  is  applicable  to  the 
multiple  objective  mathematical  programming  problem  when  the  feasible  region  is  convex 
and  the  objective  functions  are  linear.  After  developing  the  necessary  background  for 
the  shooting  idea,  we  propose  an  algorithm  for  constructing  a  discrete  representation  of 
the  efficient  set  which  uses  this  idea.  An  important  component  of  the  shooting  idea  is 
generating  discrete  representations  of  a  simplex.  We  present  two  methods  for 
accomplishing  this.   One  of  the  methods  is  probabilitistic,  and  the  other  is  deterministic. 
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CHAPTER  1 
INTRODUCTION 

Multiobjective  mathematical  programming  has  received  wide  interest  in  the  last 
twenty  years,  mostly  due  to  the  increasing  complexity  of  real  world  problems.  Many 
real  world  problems  in  which  a  single  alternative  is  chosen  from  a  number  of  potential 
alternatives  actually  include  more  than  one  objective.  However,  a  considerable  majority 
of  standard  mathematical  programming  models  consist  of  problems  formulated  with  a 
single  objective  function.  When  the  real  world  problem  is  indeed  a  multiple  criteria 
decision  making  (MCDM)  problem,  some  of  these  single-objective  models  are  artificially 
adapted  to  the  situation  by  designating  one  of  the  objectives  as  the  objective  function  of 
the  model.  The  other  objectives  are  built  into  the  constraint  set  with  prespecified  levels 
of  achievement  and/or  limitations  (see  Anderson  1972  for  several  examples  of  such 
models).  These  levels,  however,  are  usually  not  available  and  difficult  to  determine. 
Hence,  being  able  to  consider  more  than  one  objective  simultaneously  in  a  model  is  of 
significant  value  in  the  sense  that  it  provides  a  better  representation  of  the  decision 
problem. 

Throughout  this  discussion,  we  will  refer  to  the  decision  maker  (DM)  as  an 
individual  who  faces  the  problem  of  choosing  one  of  a  number  of  alternatives.  The 
analyst  is  the  person  whose  task  is  to  model  the  DM's  problem. 
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The  set  X  c  r°  of  alternatives  is  the  set  of  programs  or  plans  from  which  the 

DM  chooses  one. 

The  set  Y  Q  R^  is  the  set  of  possible  criteria  (or  attribute)  values  of  the 
alternatives,  where  p  >  1  is  an  integer. 

The  criteria  function  f(x)  =  [fi(x),  f2(x),...,fp(x)],  where  for  each  i  =  l,..,p,  f,: 
R"-*R,  assigns  each  alternative  x  in  X  a  unique  set  of  p  attribute  (criterion)  values. 

The  MCDM  problem  consists  of  the  triple  (X,  Y,f).  Throughout  this  dissertation, 
we  will  limit  our  discussion  to  the  case  where  X  is  a  convex  set,  and  f„  i  =  l,..p,  are 
concave  functions  on  X. 

MCDM  was  reported  to  be  the  most  rapidly  growing  field  of  OR/MS  during  the 
1970's  (Zeleny  1982).  The  research  in  this  area  has  its  roots  in  earlier  times,  however. 
Kuhn  and  Tucker  (1951)  formulated  the  vector  maximization  problem  and  Koopmans 
(1951)  gave  proofs  of  necessary  and  sufficient  conditions  for  efficiency. 

Increasing  interest  in  MCDM  is  primarily  due  to  increasing  appreciation  of  the 
inherent  multiple  objective  nature  of  most  decision  problems,  and  to  rapid  improvements 
in  computer  technology.  The  latter  development  is  especially  important,  since  algorithms 
for  multiobjective  mathematical  programs  usually  require  a  significant  amount  of 
computation  time  and  storage. 

l.I.   The  Multiple  Criteria  Decision  Making  (MCDM)  Problem 

In  MCDM,  the  problem  of  primary  interest  is  choosing  an  alternative 
X  =  (x,,X2,...,xJ  in  X,  i.e.  determining  the  values  of  decision  variables  x,,  X2,...,x^  in 
order  to  optimize  p  objective  functions.   Henceforth  in  this  dissertation,  we  will  assume 


3 
that  p  >  2  for  the  purpose  of  eliminating  the  special  case  of  a  single  objective  function, 

for  which  various  optimization  techniques  exist.    Without  loss  of  generality,  we  will 

assume  that  the  DM  wants  to  maximize  each  of  these  objective  functions  simultaneously. 

(It  is  well  known  that  an  objective  function  to  be  minimized  can  be  modified  to  fit  into 

this  scheme  by  maximizing  the  negative  of  the  original  objective  function.)  We  can  state 

the  multiobjective  mathematical  programming  problem  as: 

VMAX  f(x)  =  [  f,(x),  f,(x),...,  fp(x)  ]  , 
(MMP) 

s.t.    X  e  X. 

Definition   l.l.l.     A  solution  x'  to  problem  (MMP)  which  maximizes  each  of  the 

objective  functions  simultaneously  is  called  a  superior  solution,  i.e.,  x'  is  said  to  be  a 

superior  solution  if  and  only  if  x'  G  X  and  fi(x')  >  fi(x)  for  i  =  l,2,...,p  and  for  all 

X  e  X. 

Definition  I.I.2.    The  ideal  solution  for  problem  (MMP)  is  a  point  f  =  (f\,f\,.--,il)  in 

the  outcome  space  such  that  t]  for  i  -  l,2,..p  is  the  optimal  objective  value  for  the 

problem: 

Maximize    f(x)      s.t.       x  G  X. 

Observe  that  a  superior  solution  yields  the  ideal  solution  for  problem  (MMP).  A 
superior  solution  resembles  an  optimal  solution  for  a  single  objective  optimization 
problem  in  the  sense  that  it  is  a  most  desirable  solution.  However,  with  rare  exceptions, 
the  objective  functions  of  problem  (MMP)  are  conflicting  in  nature,  so  that  no  superior 
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solutions  exist.    In  this  case,  the  DM  is  interested  in  efficient  solutions,  also  called 

Pareto-optimal  or  nondominated  solutions. 

Definition  I.I.3.    A  solution  x°  G  X  is  an  efficient  solution  of  problem  (MMP)  when 

x°  e  X,  and  whenever  f(x)  >  f(x°),  then  f(x)  =  fCx'^. 

Let  Xe  denote  the  set  of  efficient  solutions  for  problem  (MMP). 

An  alternative  x  belongs  to  X^  if  there  exists  no  other  alternative  which  does  at 
least  as  well  in  each  objective  function  and  better  in  at  least  one  objective  function.  So, 
under  the  "more  is  better"  assumption,  only  the  alternatives  in  the  set  of  efficient 
solutions  of  problem  (MMP)  need  to  be  considered  by  the  DM.  In  most  cases,  there  will 
be  more  than  one  efficient  solution.  Therefore,  it  is  often  necessary  to  rank  the  efficient 
solutions,  or  to  identify  a  most  preferred  solution.  To  accomplish  this,  information  about 
the  DM's  preference  structure  is  required.  The  time  at  which  this  information  is  needed 
constitutes  a  factor  of  discrimination  among  various  procedures  proposed  to  solve  the 
MCDM  problem. 

1.2.    Solution  Procedures  for  the  MCDM  Problem 

In  this  dissertation,  we  will  partially  employ  the  framework  used  by  Evans  (1984). 
We  will  review  methods  classified  into  three  categories  on  the  basis  of  the  time  at  which 
the  DM  needs  to  articulate  his/her  preference  structure  on  the  set  of  feasible  alternatives 
X.  Although  the  methods  in  these  categories  differ  significantly,  the  goal  is  to  either  find 
a  most  preferred  solution  or  provide  the  DM  with  sufficient  information  so  that  he/she 
can  identify  a  most  preferred  solution. 
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The  first  category  consists  of  techniques  which  require  prior  elicitation  of  the 

DM's  preference  structure.  The  methods  in  this  category  either  seek  an  explicit 
formulation  of  the  DM's  preferences,  as  in  multiattribute  utility  theory  (Keeney  and 
Raiffa  1976),  or  implicitly  presume  a  form  of  preference  structure,  as  in  goal 
programming  (Lee  1973),  compromise  programming  (Zeleny  1973),  and  lexicographic 
ordering  (Keeney  and  Raiffa  1976). 

In  the  multiattribute  utility  theory  approach,  the  DM's  preference  structure  must 
satisfy  a  set  of  global  assumptions,  which  are  often  quite  restrictive.  Through  a  set  of 
carefully  structured  questions,  the  analyst  has  to  determine  the  DM's  value  function.  The 
MCDM  problem  is  then  usually  formulated  and  solved  as  a  single  objective  optimization 
problem  yielding  a  most  preferred  solution.  However,  the  preference  information 
requested  from  the  DM  in  these  procedures  is  often  difficult  to  assess.  The  DM  is  asked 
to  make  value  judgements  without  having  enough  knowledge  of  Xg,  and  the  responses 
provided  by  the  DM  are  required  to  be  more  precise  than  he/she  is  usually  capable  of. 

Methods  that  do  not  require  the  determination  of  the  value  function  (e.g.  goal 
programming,  compromise  programming)  still  require  the  DM  to  assess  the  values  of 
certain  parameters.  However,  since  the  DM's  knowledge  about  Xg  is  limited,  and  the 
effect  of  the  parameters  on  the  solution  obtained  is  not  obvious,  it  is  not  a  simple  task 
to  determine  these  parameters. 

The  methods  that  use  prior  articulation  of  the  DM's  preferences  identify  only  one 
solution,  which  is  not  usually  guaranteed  to  be  an  efficient  solution.  This  is  not  a 
desirable  situation  if  the  "more  is  better"  assumption  holds. 
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At  the  other  end  of  the  spectrum  are  the  methods  that  use  posterior  articulation 

of  the  DM's  preferences.  These  methods  attempt  to  find  all  or  some  of  the  efficient 
solutions  of  problem  (MMP).  The  DM  then  chooses  his/her  most  preferred  solution 
among  the  solutions  thus  found.  However,  characterizing  efficient  solutions  may  not  be 
easy  unless  problem  (MMP)  possesses  a  special  structure.  Therefore,  the  methods  that 
use  posterior  articulation  of  the  DM's  preferences  usually  consider  special  instances  of 
problem  (MMP).  These  approaches  may  still  require  intense  computational  effort.  Since 
these  methods  convey  the  maximum  information  to  the  DM,  the  DM  may  be 
overwhelmed  by  the  number  of  efficient  solutions  being  presented.  (A  more  detailed 
discussion  of  methods  that  use  posterior  articulation  of  the  DM's  preferences  is  deferred 
to  Section  1.3.) 

Between  these  two  categories  are  the  methods  that  use  progressive  articulation  of 
the  DM's  preferences,  generally  referred  to  as  interactive  algorithms.  Interactive 
algorithms  are  designed  with  the  purpose  of  overcoming  the  difficulties  associated  with 
the  methods  in  the  other  two  categories.  The  major  property  of  the  methods  in  this 
category  is  that  preference  information  is  requested  from  the  DM  as  needed  during  the 
implementation  of  the  algorithm.  This  is  achieved  by  an  iterative  DM/machine 
interaction. 

In  a  typical  interactive  algorithm,  the  procedure  is  initiated  by  constructing  a 
single  objective  optimization  problem,  which  is  in  some  way  related  to  the  original 
multiobjective  programming  problem.  Then  a  solution  is  found  for  the  single  objective 
problem.     Based  on  the  outcome  of  this  solution,  the  DM  is  asked  to  provide  some 
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information  regarding  his/her  preferences  over  the  multiple  objectives.  This  information 

is  then  utilized  in  constructing  another  single  objective  problem  for  the  next  iteration. 
The  procedure  terminates  when  the  DM  or  the  computer  program  identifies  the  current 
solution  as  a  most  preferred  solution. 

The  interactive  nature  of  these  methods  enhances  their  practicality.  Furthermore, 
the  DM  may  acquire  more  information  about  the  efficient  set  Uiroughout  the 
implementation  of  the  procedure.  However,  some  disadvantages  can  be  stated  as 
follows. 

a)  Interactive  methods  presuppose  an  arbitrary  degree  of  precision  in  the  DM's 
responses. 

b)  The  DM  is  not  allowed  to  decline  providing  specific  information,  and  cannot  alter 
previous  responses. 

c)  Interactive  methods  require  the  DM  to  take  an  active  part  each  time  an  optimization 
problem  is  solved. 

d)  Some  rely  on  arbitrary  rules  rather  than  testable  procedures. 

e)  Only  one  solution  is  generated  although  many  solutions  may  be  consistent  with  the 
DM's  preferences. 

Methods  that  use  prior  articulation  of  the  DM's  preferences  have  been  Uie  least 
preferred  among  the  three  categories,  mainly  due  to  the  restrictive  assumptions  that  they 
require.  Methods  that  use  posterior  and  progressive  articulation  of  the  DM's  preferences 
have  been  the  focus  of  the  studies  towards  solving  problem  (MMP).   The  main  goal  of 
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posterior  and  progressive  methods  is  to  allow  the  DM  to  acquire  sufficient  information 

about  Xe  so  that  he/she  can  identify  a  most  preferred  solution. 

The  methods  that  use  posterior  articulation  of  the  DM's  preferences  are  also 
referred  to  as  vector  maximization  methods.  When  the  objective  function  and/or  the 
feasible  region  of  problem  (MMP)  fail  to  possess  some  special  structure  that  makes  it 
easy  to  solve,  solving  the  problem  becomes  a  formidable  task  even  with  a  single 
objective  function.  Therefore,  the  vector  maximization  algorithms  concentrate  on  special 
instances  of  problem  (MMP).  We  will  now  briefly  discuss  the  main  properties  of  the 
vector  maximization  methods. 

1.3.    Vector  Maximization  Approaches  to  Problem  (MM?) 

Except  for  a  few  studies  (see  Section  2.3.2. 1),  much  of  the  attention  in  the  area 
of  vector  maximization  has  been  on  the  linear  case. 

Let  X  ^  R"  be  a  nonempty  polyhedron.  Assume  that  c,^  6  R°,  i  =  l,2,...,p,  are 
row  vectors.  Let  C  denote  the  pxn  matrix  whose  i*  row  equals  c,^,  i  =  l,2,...,p.  Then 
the  multiple  objective  linear  programming  problem  (MOLP)  may  be  written 

(MOLP)  VMAX    Cx  ,        s.t.    xGX. 

Problem  (MOLP)  represents  the  special  linear  instance  of  problem  (MMP).  In 
subsequent  chapters,  we  will  use  the  notation  d,  j  =  l,..,n,  to  denote  thej"*  column  of  C. 

A  number  of  vector  maximization  algorithms  have  been  proposed  for  solving 
problem  (MOLP).  A  survey  of  these  methods  is  presented  in  Chapter  2.  It  is  well 
known  that  the  set  of  efficient  solutions  Xg  is  a  union  of  efficient  faces  of  X.  The  vector 
maximization  methods  usually  attempt  to  identify  all  of  the  efficient  extreme  point 
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solutions  and  efficient  extreme  directions  of  problem  (MOLP).     The  set  of  efficient 

solutions  presented  to  the  DM  then  is  either  the  set  of  all  the  efficient  extreme  point 
solutions  thus  found,  or  the  set  of  all  efficient  solutions  characterized  as  a  union  of 
efficient  faces.  Typically,  the  suggested  algorithms  are  simplex-based  and  utilize 
pivoting  operations  as  a  major  tool.  Hence  the  computational  time  required  by  these 
algorithms  increases  with  the  problem  size  (see,  for  instance,  Evans  and  Steuer  1973a, 
Ecker  and  Kouada  1978,  Isermann  1977).  Another  complication  is  the  presence  of 
degeneracy,  in  which  case  the  procedures  either  lose  applicability  or  become  even  more 
cumbersome. 

Some  general  difficulties  associated  with  the  vector  maximization  algorithms  can 
be  stated  as  follows. 

a)  When  X  is  a  continuous  set,  X^  may  be  uncountably  infinite.  It  is  thus  not  easy  for 
the  DM  to  choose  a  most  preferred  solution  from  X^. 

b)  The  partial  solution  set  obtained  by  some  of  the  linear  vector  maximization 
algorithms,  i.e.,  the  set  of  efficient  extreme  points,  may  still  be  too  large,  and  hence  may 
overwhelm  the  DM. 

c)  Organizing  the  efficient  extreme  points  in  a  presentable  manner  is  a  difficult  task. 

d)  The  set  of  all  efficient  extreme  points  of  problem  (MOLP)  may  not  provide  a  good 
representation  of  Xg.  (Steuer  [1986]  notes  that  some  of  the  extreme  points  of  a 
polyhedron  may  be  clustered  together,  while  others  may  be  quite  distant  from  one 
another.) 
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e)  There  may  not  be  a  most  preferred  solution  for  problem  (MOLP)  that  is  an  extreme 

point  of  X. 

There  are  also  some  advantages  of  the  vector  maximization  approach.  Among 
the  methods  in  the  three  categories,  the  vector  maximization  methods  provide  the 
maximum  information  about  X^,  and  thus  have  the  potential  for  helping  the  DM  learn 
about  Xe  in  a  satisfactory  manner.  Furthermore,  the  vector  maximization  algorithms  do 
not  require  any  preference  information  from  the  DM. 

One  way  of  overcoming  the  difficulties  associated  with  the  vector  maximization 
approach  is  to  obtain  a  discrete  representation  of  the  efficient  set.  Ideally,  this 
representation  should  be  designed  to  provide  sufficient  information  about  X^  without 
overwhelming  the  DM.  As  we  have  seen,  the  set  of  efficient  extreme  points  of  X  fails 
to  be  an  ideal  representation.  These  points  may  not  portray  X^  well,  may  still  be 
overwhelming,  and  are  usually  obtained  via  computationally-expensive  procedures. 

To  date,  no  precise  method  has  been  proposed  to  obtain  a  discrete  sample  of 
efficient  points  that  does  not  consist  of  solely  extreme  points,  although  the  idea  has 
occasionally  been  stated  with  varying  degrees  of  ngor  (Armann  1989,  Steuer  1986). 
However,  some  suggestions  have  been  made  in  order  to  eliminate  the  problems  associated 
with  describing  the  efficient  set  of  problem  (MOLP).  The  suggested  procedures  attempt 
to  reduce  the  number  of  efficient  extreme  points  presented  to  the  DM. 

The  point  estimate  weighted-sums  approach  (Steuer  1986)  is  designed  to  generate 
one  efficient  extreme  point  of  problem  (MOLP)  at  a  time.  To  find  each  such  point,  it 
assigns  to  each  objective  function  a  positive  weight  and  solves  the  resulting  single 
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objective  linear  program.  However,  determining  the  appropriate  weighting  factors,  and 
varying  these  weights  so  as  to  obtain  a  representative  sample  of  X^  poses  a  problem  that 
is  not  easy  to  solve.  Also,  although  possibly  fewer  in  number,  the  efficient  points 
obtained  as  a  result  of  this  procedure  belong  to  X,,,  which,  as  we  have  seen,  may  not 
represent  X^  appropriately. 

The  method  of  interval  criterion  weights  (Steuer  1976a)  designates  intervals  for 
the  objective  function  weights  rather  than  point  estimates.  This  method  also  yields  a 
subset  of  the  efficient  extreme  points  of  problem  (MOLP)  when  solved  as  a  vector 
maximization  problem  after  some  restructuring.  Although  easier  than  specifying  point 
estimates  of  weights,  there  is  no  a  priori  method  of  determining  the  intervals  that  would 
yield  a  solution  set  that  contains  the  DM's  most  preferred  solution.  Moreover,  the 
resulting  vector  maximization  problem  may  still  require  a  considerable  amount  of 
computation. 

To  help  with  the  problem  of  organizing  the  efficient  extreme  points  into  a 
presentable  form,  the  idea  of  clustering  these  points  has  been  suggested  (Morse  1980). 
Another  suggestion  is  to  eliminate  some  of  the  "redundant"  efficient  extreme  points  via 
various  techniques  of  filtering  (Steuer  1976b,  Steuer  and  Harris  1980).  Clustering  and 
filtering  techniques  do  not  save  the  computational  effort  required  to  generate  these  points. 
Furthermore,  the  problem  of  underrepresenting  X^  by  efficient  extreme  points  is  not 
solved  with  these  approaches. 

From  the  above  discussion,  one  can  deduce  that  a  good  representation  of  the 
efficient  set  should  be  complete,  but  should  not  contain  points  that  are  clustered  together, 
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and  thus  are  redundant.  An  approach  that  may  be  of  practical  use  in  attempting  to  obtain 

such  a  representation  is  solving  the  problem  of  optimizing  a  linear  function  over  the 

efficient  set. 

1.4.    Optimizing  a  Linear  Function  Over  the  Efficient  Set 

Recently,  the  problem  of  optimizing  a  linear  function  over  the  efficient  set  of 
problem  (MOLP)  has  been  the  focus  of  several  studies.  This  problem  arose  at  least 
partially  in  response  to  the  difficulties  in  using  multiple  objective  linear  programming  as 
a  decision  aid.  If  a  linear  function  is  available  which  acts  as  a  criterion  for  measuring 
the  importance  of  the  efficient  solutions  of  problem  (MOLP),  then  optimizing  this 
function  over  the  efficient  set  avoids  generation  of  all  of  the  efficient  solutions. 

The  problem  of  optimizing  a  linear  function  over  the  efficient  set  Xg  of  problem 
(MOLP)  was  first  introduced  by  Philip  (1972).  This  problem,  denoted  as  problem  (P), 
is  given  by 

(P)  max     <  d,x  >,      s.t.  x  G  X^, 

where  d  E  R°.    Let  Vj  denote  the  optimal  objective  function  value  of  problem  (P). 

A  special  case  of  problem  (P)  occurs  when  d  =  w^C  for  some  w  G  R^.  In  this 
case,  d  is  linearly  dependent  on  the  rows  of  C,  the  matrix  of  objective  function 
coefficients  of  problem  (MOLP).  Henceforth,  we  will  denote  this  special  case  of 
problem  (P)  as  problem  (PD). 

An  important  special  case  of  problem  (PD)  occurs  when  d  =  — c,  for  some 
i  G  {l,2,...,p}.  In  this  case,  problem  (PD)  seeks  the  minimum  value  of  the  objective 
function   <Ci,x>  over  the  efficient  set  of  problem  (MOLP).  The  fact  that  problem  (PD) 
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can  be  specialized  to  solve  the  problem  of  minimizing  an  objective  function    <Ci,x> 

of  problem  (MOLP)  over  X^  serves  several  useful  purposes  of  its  own  in  multiple  criteria 

decision  making.   The  optimal  value  of  this  problem,  along  with  the  maximum  value  of 

the  same  objective  function  over  X^,  defines  the  range  of  values  that    <Cj,x>    takes 

over  Xe  .  Knowledge  of  this  range  aids  the  decision  maker  in  setting  goals,  evaluating 

points  in  Xe  and  ranking  objective  functions  (Isermann  and  Steuer  1987).  In  a  way,  the 

points  that  achieve  the  maximum  and  minimum  of  objective  functions  constitute  a 

discrete  representation  of  the  efficient  set,  albeit  very  sparse.     This  representation, 

however,  helps  in  defining  the  extremities  of  the  efficient  set  in  terms  of  objective 

function  values.    Therefore,  along  with  other  ideas,  this  particular  approach  may  be  of 

relevance  in  finding  a  discrete  representation  of  Xg. 

A  detailed  discussion  of  the  solution  procedures  proposed  for  problem  (P)  is 
deferred  to  Chapter  2. 

1.5.    Contents  of  the  Dissertation 

Among  the  three  categories  of  approaches,  most  of  the  recent  work  towards 
solving  problem  (MM?)  has  concentrated  on  approaches  that  use  progressive  or  posterior 
articulation  of  the  DM's  preferences.  Methods  that  use  prior  articulation  of  the  DM's 
preferences  generally  suffer  from  either  demanding  too  much  preference  information 
from  the  DM,  or  making  restrictive  assumptions  in  order  to  represent  the  problem. 
However,  along  with  the  advantages  that  make  progressive  and  posterior  approaches 
more  favorable,  these  approaches  also  have  various  disadvantages  (cf.  Section  1.2  and 
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Section  1.3).   Thus,  none  of  the  three  types  of  approaches  is  fully  adequate  as  a  means 

for  solving  problem  (MMP). 

Interactive  algorithms  are  usually  designed  to  enhance  computational  practicality. 
This  is  usually  achieved  at  the  expense  of  relying  on  arbitrary  rules.  They  may  require 
preference  information  from  the  DM  that  is  not  easy  to  assess,  and  may  not  provide 
sufficient  information  about  Xg. 

Vector  maximization  algorithms  do  not  require  any  preference  information  from 
the  DM.  They  are  usually  unwieldy  in  terms  of  computational  requirements.  They  are 
designed  to  provide  the  maximum  information  about  X^.  This  information  may  consist 
of  either  all  of  the  efficient  solutions,  or  all  of  the  efficient  extreme  point  solutions. 
However,  the  information  generated  as  a  result  of  these  procedures  may  be  difficult  to 
organize  and  present,  and  is  usually  overwhelming  to  the  DM.  Furthermore,  if  the 
suggested  solution  consists  of  the  extreme  points  that  belong  to  Xg,  this  discrete 
representation  may  fail  to  portray  X^  in  a  comprehensive  way. 

In  the  dissertation,  we  will  concentrate  on  the  problem  of  finding  a  discrete 
representation  of  the  efficient  set  of  problem  (MMP).  Our  ultimate  goal  is  to  find  a 
"well-dispersed,"  but  adequate  discrete  representation  of  the  efficient  set  with  minimal 
computational  effort.  We  will  present  a  procedure  for  obtaining  a  discrete  representation 
that  does  not  consist  of  solely  extreme  points.  The  procedure  will  not  require  any 
preference  information  from  the  DM  prior  to,  or  during  implementation.  No  attempts 
will  be  made  to  identify  all  of  the  extreme  points  that  belong  to  X^. 
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In  this  way,  finding  a  discrete  representation  of  X^  combines  the  advantages  of 

progressive  and  posterior  approaches  while  eliminating  their  most  common  disadvantages. 

We  also  study  the  problem  of  optimizing  a  linear  function  over  the  efficient  set. 
The  fact  that  problem  (P)  can  be  specialized  to  find  the  criterion  ranges  over  the  efficient 
set  helps  in  representing  the  efficient  set.  Moreover,  under  certain  assumptions,  solving 
problem  (P)  eliminates  the  need  for  the  representation  of  all  of  Xg. 

A  literature  survey  of  the  MCDM  problem  will  be  presented  in  Chapter  2. 
Emphasis  will  be  placed  on  the  vector  maximization  approach  while  methods  that  use 
prior  and  progressive  articulation  of  the  DM's  preferences  will  be  briefly  reviewed. 
Algorithms  for  solving  the  problem  of  optimizing  a  linear  function  over  the  efficient  set 
will  also  be  discussed. 

Chapter  3  contains  some  studies  towards  solving  problem  (PD)  optimally.  Our 
work  is  motivated  by  a  recent  algorithm  for  solving  problem  (PD)  (Benson  1991c).  The 
algorithm  calls  for  repeatedly  solving  certain  similar  concave  minimization  problems  in 
one  of  its  steps.  Since  the  major  computational  requirement  of  Benson's  algorithm  is 
solving  these  problems,  it  is  important  that  an  efficient  procedure  be  employed.  We  will 
present  a  finite  branch  and  bound  algorithm  with  a  neighbor  generation  process  to 
minimize  a  concave  function  over  a  compact  polyhedron. 

In  Chapter  4,  we  study  the  problem  of  optimizing  a  linear  function  over  the 
efficient  set.  Some  results  pertaining  to  certain  special  cases  of  the  problem  of 
optimizing  a  linear  function  over  the  efficient  set  of  problem  (MOLP)  will  be  presented. 
Methods   for  solving   problem   (P)   optimally   when   any   of  these   special   cases   is 
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encountered     will  be  given.     A  heuristic  algorithm  for  solving  problem  (P)  will  be 

proposed. 

Our  ideas  for  finding  a  discrete  representation  of  the  efficient  set  of  problem 
(MMP)  will  be  presented  in  Chapter  5.  In  the  special  instance  of  problem  (MM?)  that 
we  consider,  the  objective  functions  of  problem  (MMP)  are  assumed  to  be  linear,  and 
the  feasible  region  is  assumed  to  be  compact  and  convex.  We  will  introduce  a  global 
approach  to  the  problem  of  obtaining  a  representative  sample  of  efficient  points.  We  will 
give  an  algorithm  that  is  designed  to  obtain  a  good  representation  of  Xg  that  is  well- 
dispersed,  and  that  does  not  consist  solely  of  extreme  points. 

Finally,  in  Chapter  6,  an  overall  summary  and  conclusions  will  be  given,  and 
directions  for  further  research  for  each  problem  will  be  discussed. 


CHAPTER  2 
LITERATURE  SURVEY 
In  this  chapter,  we  will  present  a  literature  survey  of  the  methods  that  have  been 
proposed  to  solve  problem  (MMP).     Since  our  research  is  m  the  area  of  vector 
maximization,  emphasis  will  be  placed  on  the  methods  that  use  posterior  articulation  of 
the  DM's  preferences.  In  Sections  2.1  and  2.2  we  will  discuss  the  methods  that  use  prior 
and  progressive  articulation  of  the  DM's  preferences,  respectively.  We  will  present  some 
samples  of  methods  in  these  two  categories  rather  than  a  complete  review.    Our  goal  is 
to  give  the  reader  a  flavor  of  the  methods  that  use  prior  and  progressive  articulation  of 
the  DM's  preferences.    In  Section  2.3,  a  more  comprehensive  discussion  of  the  vector 
maximization  approach  will  follow.  Also,  in  Section  2.3,  we  will  present  reviews  of  the 
methods  and  ideas  that  have  been  suggested  for  solving  the  problem  of  optimizing  a 
linear  function  over  the  efficient  set,  and  for  finding  a  discrete  representation  of  the 
efficient  set. 

2.1.    Methods  That  Use  Prior  Articulation  of  the  DM's  Preferences 
Methods  that  use  prior  articulation  of  the  DM's  preferences  can  be  characterized 
by  one  general  aspect  they  share.  These  methods  are  all  based  on  the  idea  of  the  DM's 
value  function. 
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Definition  2.1.1.    A  function  u,  which  associates  a  real  number  j^(f(x))  to  each  x  G  X 

is  said  to  be  a  value  function  representing  a  particular  DM's  preference     structure 

provided  that  for  each  x',  x^  G  X, 

1)  f(x')  -  f(x2)  if  and  only  if  v(f(x'))  =  v(f(x^),  and 

2)  f(x')  >  f(x2)  if  and  only  if  v(f(x'))  >  v(f(x2)), 

where  f(x')  —  f(x^)  denotes  that  the  DM  is  indifferent  between  outcomes  f(x')  and  f(x^, 
and  f(x')  >  f{x^  denotes  that  the  DM  prefers  outcome  f(x')  to  outcome  f(x^). 
A  more  detailed  discussion  of  value  functions,  which  are  sometimes  referred  to  as  utility 
functions,  can  be  found  in  Keeney  and  Raiffa  (1976). 

Methods  that  use  prior  articulation  of  the  DM's  preferences  differ  in  the  way  they 
utilize  the  value  function.  There  have  been  two  approaches  in  MCDM  using  the  concept 
of  a  value  function. 

One  approach  is  to  explicitly  use  a  value  function.  This  approach  is  known  as 
multiattribute  utility  theory  (Keeney  and  Raiffa  1976).  This  technique  involves  two 
steps:  ' 

i)   find  the  value  function  v  of  the  DM, 

ii)  solve  the  single  objective  mathematical  programming  problem 

(U)  Max    4  f,(x),  f2(x),...,  t;(x)  ], 

s.t.     xGX, 

for  an  optimal  solution  x',  which  is  called  a  best  compromise  solution  or  a  most 
preferred  solution. 
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As  mentioned  earlier,  the  multiattribute  utility  theory  approach  makes  explicit  use 

of  the  value  function.   This,  however,  constitutes  a  disadvantage  for  the  implementation 

of  the  technique.    In  order  to  find  the  value  function,  the  DM's  preferences  among  the 

alternatives  in  X  must  satisfy  a  set  of  global  assumptions.    To  apply  the  technique,  the 

analyst,  by  asking  the  DM  a  carefully-structured  set  of  questions,  first  has  to  verify  that 

the   global   assumptions   are   satisfied.      Although   alternative   forms  of  the  global 

assumptions  may  be  stated,  their  verification  is  not  an  easy  task.    Furthermore,  if  the 

assumptions  fail,  the  analyst  cannot  continue  because  no  value  function  is  obtained.    If 

the  global  assumptions  are  satisfied,  then  the  value  function  can  be  obtained  by  asking 

the  DM  more  questions. 

The  value  function  aggregates  the  p  criteria  into  one  function.  This  enables  the 
analyst  to  solve  the  single  objective  optimization  problem  (U)  to  obtain  the  DM's  most 
preferred  solution.  When  the  components  of  problem  (U)  have  certain  characteristics, 
solving  problem  (U)  becomes  relatively  easy. 

If  the  assessment  of  the  value  function  is  completed  successfully,  and  a  solution 
is  found,  although  it  is  guaranteed  to  be  a  most  preferred  solution,  it  is  not  guaranteed 
to  be  efficient  unless  the  value  function  of  the  DM  is  strictly  increasing  in  its  arguments. 

A  second  approach  using  a  priori  articulation  of  the  DM's  preferences  is  to 
implicitly  use  a  value  function,  as  in  goal  programming  (Lee  1973),  compromise 
programming  (Zeleny  1973),  and  lexicographic  ordering  (Keeney  and  Raiffa  1976). 
Since  the  derivation  of  the  value  function  is  quite  cumbersome,  dealing  with  this  issue 
implicitly  yields  a  more  practical  approach.  Although  much  easier  to  implement  than  the 
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multiattxibute  utility  theory  approach,   the  implicit  assumptions  associated  with  the 

methods  using  this  approach  may  be  restrictive.    Furthermore,  the  methods  yield  only 

one  solution,   whereas  a  number  of  solutions  might  be  consistent  with  the  DM's 

preferences.    They  also  fail  to  guarantee  that  the  solution  found  is  efficient. 

For  further  details  on  the  methods  that  use  a  priori  articulation  of  the  DM's 

preferences,  the  reader  is  referred  to  Kombluth  (1973),  Huber  (1974),  Keeney  and  Raiffa 

(1976),  Farquhar  (1977). 

2.2.    Methods  That  Use  Progressive  Articulation  of  the  DM's  Preferences 

(Interactive  Algorithms) 

Interactive  algorithms  have  the  objective  of  eliminating  the  difficulties  that  arise 
when  the  methods  that  use  prior  articulation  of  the  DM's  preferences  are  employed.  As 
in  the  methods  that  belong  to  the  first  category,  the  emphasis  is  on  finding  a  single 
solution  that  the  DM  most  prefers.  However,  the  DM's  preferences  are  used  while  the 
technique  is  being  used  rather  than  before  the  implementation  of  the  method. 

Algorithms  in  this  category  often  involve  an  interactive  DM/computer  approach. 
During  the  initial  step  of  a  typical  interactive  algorithm,  an  initial  feasible  solution  is 
obtained,  often  via  a  single  objective  optimization  problem  which  is  in  some  way  related 
to  the  original  multiobjective  problem.  Next,  the  DM  is  asked  to  provide  some 
information  about  his/her  preferences  with  regard  to  the  outcome  of  this  solution.  Based 
on  the  answer  of  the  DM,  the  computer  provides  another  solution,  again  probably  via  a 
single  objective  optimization  problem.  The  procedure  continues  in  this  manner  until  the 
DM  decides  that  the  current  solution  is  a  most  preferred  solution  to  the  MCDM  problem. 
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The  algorithms  in  this  category  differ  in  the  type  of  the  single  objective 

optimization  problem  solved  at  each  iteration  and/or  in  the  information  elicited  from  the 
DM  (Kok  1986,  Ringuest  and  Gulledge  1985).  Although  some  of  these  algorithms 
involve  elicitation  of  some  trade-off  information,  which  may  be  difficult  to  assess  (Dyer 
1973,  Wallenius  1975),  in  general,  the  required  information  is  easier  for  the  DM  to 
provide  compared  to  the  methods  in  the  first  category. 

One  of  the  earliest  algorithms  in  this  category  is  that  of  Geoffrion,  Dyer  and 
Feinberg  (1972).  Their  procedure  is  based  on  the  assumption  that  the  DM's  value 
function  indeed  exists,  and  is  concave  and  nondecreasing  in  its  arguments,  but  is  not 
available.  Their  algorithm  applies  to  problem  (MMP)  when  X  is  a  compact  polyhedron, 
and  fj,  i  =  l,..,p  are  concave  and  differentiable.  Therefore,  if  the  DM's  value  function 
were  available,  problem  (U)  would  be  a  simple  convex  program,  and  could  be  solved  to 
obtain  a  most  preferred  solution.  The  key  idea  of  the  method  is  to  implement  the  Frank- 
Wolfe  Method  on  problem  (U)  without  explicitly  knowing  the  value  function  u,  and  to 
ask  the  DM  appropriate  questions  when  some  information  about  i>  is  needed. 

Marcotte  and  Soland  (1986)  presented  a  particularly  inventive  interactive  branch 
and  bound  algorithm  for  solving  problem  (MMP).  They  suggested  solving  an  equivalent 
transformed  problem  in  the  objective  function  space.  Their  algorithm  is  significant  in 
more  than  one  respect.  First,  it  does  not  require  even  the  assumption  of  the  existence 
of  a  value  function.  Rather,  it  is  assumed  that  the  DM's  preference  structure  ensures  the 
existence  of  indifference  curves.    Second,  it  can  be  applied  to  problem  (MMP)  when  Y 
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is  either  convex  or  discrete.    Finally,  it  provides  an  efficient  solution  even  if  the  DM 

decides  to  stop  before  the  algorithm  terminates. 

In  general,  interactive  algorithms  tend  to  be  much  more  practical  than  the 
algorithms  that  require  prior  articulation  of  the  DM's  preferences.  Specifically, 
information  demanded  from  the  DM  by  the  interactive  methods  is  more  reasonable  than 
in  the  methods  in  the  first  category.  The  interactive  methods  are  also  usually 
computationally  tractable.  Moreover,  interactive  algorithms  let  the  DM  see  various 
feasible  solutions,  explore  the  feasible  region  somewhat,  and  learn  some  of  the  trade-offs 
available  in  the  objective  functions.  This  enables  the  DM  to  understand  the  chosen 
solution  better  and  to  have  more  confidence  in  it.  An  ultimate  superiority  in  terms  of 
practicality  of  the  interactive  algorithms  over  the  methods  that  utilize  prior  articulation 
of  preferences  is  that  there  is  no  explicit  or  implicit  attempt  to  find  the  DM's  value 
function. 

However,  there  are  also  a  number  of  disadvantages  associated  with  the  methods 
that  use  progressive  articulation  of  the  DM's  preferences.  Many  require  more  precision 
in  the  DM's  responses  than  is  possible,  and  usually,  previous  responses  cannot  be 
altered.  Only  one  solution  is  generated,  even  though  a  whole  set  of  solutions  may  be 
consistent  with  the  DM's  preferences.  Furthermore,  in  many  interactive  algorithms,  the 
solutions  generated  throughout  the  application  of  the  algorithm,  including  the  solution 
suggested  as  the  most  preferred  solution,  may  not  be  efficient.  Typically,  only  a  few 
points  in  X  or  Xg  are  explored  while  implementing  an  interactive  algorithm.  Thus  the 
DM  may  not  be  provided  with  sufficient  information  about  Xg.   Potentially,  the  solution 
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that  is  identified  as  the  most  preferred  may  be  less  preferred  to  some  other  efficient 

solution  that  lies  in  some  unexplored  portion  of  X. 

Finally,  most  of  the  algorithms  in  this  category  suffer  from  being  ad  hoc  in  the 
sense  that  they  rely  on  arbitrary  rules  rather  than  testable,  logical  rules  related  to  the 
value  function. 

Recently,  interactive  algorithms  for  solving  problem  (MMP)  have  been  very 
popular.  This  is  mostly  due  to  the  progress  in  microcomputer  software.  An  enormous 
number  of  interactive  algorithms  have  been  proposed  (see  Larichev  1971,  Wallenius 
1975,  Steuer  1977,  Hwang  and  Masud  1979,  White  1980,  Evans  1984,  Hazen  1980). 
A  recent  bibliography  of  interactive  algorithms  is  given  by  Aksoy  (1989). 

2.3.    Methods  That  Use  Posterior  Articulation  of  the  DM's  Preferences 

The  methods  in  this  category  do  not  utilize  the  DM's  preferences  until  after  the 
method  has  been  employed.  Unlike  the  other  two  categories,  these  methods  try  to  find 
many  solutions  rather  than  just  one.  The  general  procedure  consists  of  two  stages. 
First,  the  method  is  used  to  generate  all  or  many  efficient  solutions  to  problem  (MMP). 
Next,  the  set  of  solutions  generated  is  presented  to  the  DM,  and  he/she  chooses  his/her 
most  preferred  solution. 

As  implied  by  the  statement  of  the  general  procedure,  no  explicit  preference 
information  is  asked  directly  of  the  DM.  Instead,  only  a  single  implicit  preference 
assumption  is  made.  This  assumption  can  be  expressed  as  "more  is  better,"  i.e.  it  is 
assumed  that  the  DM  would  prefer  attaining  a  higher  level  in  any  of  the  objective 
functions  to  attaining  a  lower  level  of  the  same  objective  function.   This  constitutes  one 


24 

of  the  major  advantages  of  the  methods  that  use  posterior  articulation  of  the  DM's 

preferences.  However,  the  task  of  identifying  all  of  the  efficient  solutions  is  a 
formidable  one.  Moreover,  the  number  of  solutions  being  presented  to  the  DM  may  be 
overwhelmingly  enormous. 

To  represent  approaches  that  use  posterior  articulation  of  the  DM's  preferences, 
the  term  vector  maximization  has  often  been  used.  Vector  maximization  was  originally 
defined  as  the  problem  of  finding  all  of  the  efficient  solutions  of  problem  (MMP).  The 
algorithms  that  have  been  proposed  to  solve  problem  (MMP)  mostly  concentrate  on  one 
special  instance  of  the  problem,  namely  problem  (MOLP).  While  some  of  these 
algorithms  suggest  finding  all  of  the  efficient  solutions  of  problem  (MOLP),  there  has 
been  a  trend  towards  concentrating  on  finding  a  subset  of  the  efficient  set  of  problem 
(MOLP)  which,  in  some  sense,  represents  the  efficient  set. 

Most  of  the  work  towards  more  general  cases  of  problem  (MMP)  has  been 
conceptual.  Apart  from  algorithmic  approaches  that  have  concentrated  on  problem 
(MOLP),  solution  procedures  for  a  few  other  special  cases  of  problem  (MMP)  have  been 
suggested. 

In  Section  2.3.1,  we  will  present  a  review  of  some  of  the  conceptual  and 
theoretical  work  in  the  area  of  vector  maximization.  In  Section  2.3.2,  we  will  review 
some  of  the  vector  maximization  methods  that  have  been  proposed  to  solve  problem 
(MMP)  with  special  emphasis  on  problem  (MOLP).  Section  2.3.3  will  contain  an 
overview  of  the  methods  that  have  been  proposed  to  solve  the  problem  of  optimizing  a 
linear  function  over  the  efficient  set.   In  Section  2.3.4,  we  will  review  the  methods  that 
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have  been  suggested  for  finding  discrete  subsets  of  representative  points  in  the  efficient 

set  of  problem  (MOLP). 

2.3.1.    Some  Conceptual  Studies  in  Vector  Maximization 

In  one  of  the  earliest  studies  in  the  field  of  vector  maximization,  Kuhn  and  Tucker 

(1951)  defined  the  concept  of  proper  efficiency,  which  eliminates  certain  efficient  points 

that  exhibit  an  undesirable  anomaly.     Later,   Geoffrion  (1968)  noted  that  efficient 

solutions  may  exist  which  demonstrate  a  similar  anomaly,  but  are  proper  in  the  sense  of 

Kuhn  and  Tucker.   He  thus  redefined  proper  efficiency.   An  efficient  solution  that  is  not 

properly  efficient  is  said  to  be  improperly  efficient.    If  x"  is  an  improperly  efficient 

solution,  for  some  criterion  i,  the  marginal  gain  in  f,  can  be  made  arbitrarily  large 

relative  to  each  of  the  marginal  losses  in  other  criteria.    Since  the  DM's  desire  for  fj  is 

not  satisfied,  x°  is  not  a  desirable  solution.    Also,  for  nonlinear  problems,  the  concept 

of  proper  efficiency  allows  for  a  more  appropriate  characterization  than  does  the  concept 

of  efficiency.  Hence  it  seems  reasonable  to  consider  only  the  properly  efficient  solutions 

for  problem  (MMP). 

Geoffrion  provided  important  results  that  may  be  functional  in  obtaining  properly 
efficient  solutions,  particularly  under  the  assumption  of  concave  objective  functions.  He 
also  defmed  six  different  problems  related  to  proper  efficient  solutions  and  showed  their 
connections  under  certain  assumptions. 

Later,  Benson  and  Morin  (1977)  gave  necessary  and  sufficient  conditions  for  an 
efficient  solution  for  problem  (MMP)  to  be  properly  efficient.  These  conditions  relate  the 
proper  efficiency  of  a  given   solution   to  the  stability   of  certain   single  objective 
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maximization  problems.  A  direct  consequence  of  this  theory  is  that  any  efficient  solution 

for  problem  (MOLP)  is  properly  efficient.    (Also  see  Benson  1983,  Isermann  1974). 

The  concept  of  proper  efficiency  is  important  in  the  sense  that  it  enables  certain 
characterizations  that  may  have  computational  implementations.  Furthermore,  the 
exclusion  of  improperly  efficient  solutions  in  problem  (MMP)  does  not  constitute  a 
critical  problem,  since  under  certain  assumptions  (including  the  assumptions  of  a  convex 
feasible  region  and  concave  objective  functions),  the  outcome  of  any  improper  solution 
of  (MMP)  is  the  limit  point  of  the  outcomes  of  some  sequence  of  properly  efficient 
solutions  (Benson  1978). 

Yu  (1974)  proposed  a  domination  structure  over  the  objective  function  space  and 
explored  the  geometry  of  the  set  of  all  nondominated  solutions.  The  definition  of  a 
nondominated  solution  is  a  generalization  of  that  of  an  efficient  solution.  He  also 
introduced  the  concepts  of  cone  convexity  and  cone  extreme  point,  and  investigated  their 
main  properties.  Cone  convexity  can  be  regarded  as  a  generalization  of  the  concept  of 
a  convex  set.  Yu  derived  sufficient  conditions  for  Y  to  be  cone  convex  through  the 
concepts  of  polar  cones  and  polyhedral  cones.  He  showed  that  a  nondominated  solution 
must  be  a  cone  extreme  point.  Based  on  this  result,  he  outlined  a  sequential 
approximation  idea  for  locating  the  set  of  all  nondominated  solutions. 

In  his  study,  Yu  (1974)  introduced  two  approaches  for  locating  the  set  of  all 
nondominated  solutions  in  the  decision  space  through  ordinary  mathematical 
programming  problems.  Two  related  approaches  to  locate  all  nondominated  solutions  in 
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the  objective  function  space  were  also  presented.    Efficient  solutions  (see  Definition 

1.2.3)  were  studied  as  a  special  case  of  nondominated  solutions. 

In  his  pioneering  study,  Philip  (1972)  introduced  algorithmic  frameworks  for  four 
different  problems  that  are  of  importance  in  the  area  of  linear  vector  maximization. 
Although  his  methods  are  referred  to  as  "algorithms,"  we  find  it  more  appropriate  to 
review  his  work  in  this  section,  since  they  are  closer  to  being  ideas  than  readily 
implementable  algorithms.  Throughout  his  study,  Philip  considered  linear  objective 
functions  and  a  convex  (in  certain  cases  polyhedral)  feasible  region.  He  also  presented 
necessary  and  sufficient  conditions  for  a  point  on  the  boundary  of  the  feasible  region  X 
to  be  an  efficient  solution  for  problem  (MMP)  when  X  is  a  polyhedral  set.  In  general, 
Philip's  methods  use  linear  programming  as  a  tool  to  solve  the  stated  problems. 

The  problems  introduced  by  Philip  have  been  studied  by  many  researchers.  The 
first  problem  he  considered  is  the  problem  of  testing  for  efficiency  of  a  given  point.  He 
provided  two  methods  for  the  cases  where  X  is  polyhedral  and  where  the  number  of 
constraints  that  define  X  and  the  number  of  objective  functions  are  allowed  to  be  infinite. 
The  second  problem  is  the  problem  of  finding  an  initial  efficient  point  in  X  for  use  in 
interactive  or  vector  maximization  algorithms.  The  third  problem  that  he  studied  is  the 
problem  of  testing  to  see  if  a  given  efficient  point  is  the  only  efficient  point  that  exists, 
and  if  not,  finding  other  ones.  The  last  problem,  which  has  been  the  focus  of  several 
very  recent  studies,  is  the  problem  of  optimizing  a  linear  function  over  the  set  of  efficient 
solutions.    We  will  discuss  this  problem  in  more  detail  later. 
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A  special  case  of  problem  (MMP)  occurs  when  fj  =  Xj  for  each  i=l,..n.  In  this 

case,  the  efficient  pxjints  of  problem  (MMP)  are  called  admissible  points.  The  motivation 
for  studying  admissible  points  of  problem  (MMP)  comes  from  various  sources.  First, 
since  this  constitutes  a  special  case  of  problem  (MMP),  some  results  that  are  not  valid 
for  the  general  case  can  be  developed.  Second,  when  instead  of  problem  (MMP),  an 
equivalent  transformed  problem  in  the  objective  function  space  is  considered,  efficient 
solutions  of  problem  (MMP)  map  into  the  admissible  points  of  the  transformed  problem. 
Some  properties  of  admissible  points  have  been  studied  by  a  few  authors.  The  interested 
reader  is  referred  to  Arrow,  Barankin  and  Blackwell  (1953),  Bitran  and  Magnanti  (1979), 
and  Benson  (1982). 
2.3.2.    Vector  Maximization  Algorithms  for  Solving  Problem  (MMP) 

Although  most  of  the  vector  maximization  algorithms  that  have  been  proposed  for 
solving  problem  (MMP)  concentrate  on  problem  (MOLP),  a  few  algorithms  have  been 
suggested  for  some  other  special  cases  where  X  is  nonpolyhedral  or  fj,  i=l,..,p,  are 
nonlinear.    We  will  first  study  the  nonlinear  vector  maximization  algorithms. 
2.3.2.1.   Nonlinear  vector  maximization  algorithms 

The  vector  maximization  methods  that  have  been  proposed  to  solve  nonlinear 
instances  of  problem  (MMP)  concentrate  on  special  cases.  This  is  due  to  the  inherent 
difficulty  of  the  general  problem. 

Benson  (1979)  considered  the  special  case  of  problem  (MMP)  with  p=2  objective 
functions.   He  provided  a  characterization  for  efficient  points  for  this  special  case.    He 
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then  outlined  a  parametric  procedure  for  generating  the  set  of  all  efficient  points  for  this 

special  instance  of  problem  (MMP). 

Another  special  instance  of  problem  (MMP)  is  the  multiobjective  location 
problem.  In  this  special  case,  X  c  r\  and  the  problem  is  to  locate  a  new  facility,  i.e. 
determine  (x,,  x,),  so  as  to  minimize  the  "distance"  between  the  new  facility  and  each 
of  the  p  existing  facilities.  Therefore  the  objective  associated  with  each  existing  facility 
is  to  locate  the  new  facility  as  close  as  possible  to  that  facility. 

Wendell,  Hurler  and  Lowe  (1977)  studied  the  multiobjective  facility  location 
problem  when  the  distance  is  defined  as  the  rectilinear  distance.  They  developed  some 
properties  of  Xg  and  gave  two  procedures  for  generating  Xg. 

Later,  Chalmet,  Francis  and  Kolen  (1981)  studied  the  same  problem  as  Wendell, 
Hurter  and  Lowe,  and  developed  two  algorithms  for  it.  Both  of  their  algorithms  generate 
Xg.  They  also  established  that  their  second  algorithm  has  a  computational  complexity 
that  is  the  best  possible  among  all  the  algorithms  designed  for  performing  this  task. 

Although  the  methods  we  have  reviewed  in  this  section  are  valuable,  the  problem 
of  solving  more  general  instances  of  problem  (MMP)  still  needs  to  be  studied. 
2.3.2.2.    Linear  vector  maximization  algorithms 

It  is  well  known  that  the  efficient  set  of  problem  (MOLP)  can  be  represented  as 
a  union  of  the  efficient  faces  of  the  feasible  region.  Algorithms  that  are  suggested  to 
solve  problem  (MOLP)  seek  to  identify  either  all  of  the  efficient  extreme  points  of  X, 
or  all  of  the  efficient  faces  of  X.  Although  the  proposed  algorithms  differ  in  certain 
ways,  they  all  utilize  some  modified  version  of  the  simplex  method.   Usually,  some  sorts 
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of  tests  are  incorporated  into  the  solution  procedures  in  order  to  identify  pivots  that  lead 

to  efficient  vertices  or  directions  (Ecker  and  Kouada  1978,  Isermann  1977,  Evans  and 

Steuer  1973a).   In  some  procedures,  these  tests  also  produce  the  efficient  faces  incident 

to  the  current  vertex  (Ecker,  Hegner  and  Kouada  1980,  Gal  1977).   Depending  upon  the 

structure  of  the  problem,  and  especially  the  dimension  of  the  decision  space,  fmding  all 

of  the  efficient  vertices  may  become  an  overwhelming  assignment.   Hence,  it  is  not  very 

surprising  that  these  algorithms  require  a  considerable  amount  of  computer  time  and 

storage.   Worse  yet,  in  the  presence  of  degeneracy,  either  the  procedures  become  more 

cumbersome  or  inapplicable. 

One  of  the  earliest  algorithms  proposed  for  solving  problem  (MOLP)  is  that  of 
Evans  and  Steuer  (1973a).  In  their  study,  Evans  and  Steuer  presented  a  corollary  which 
states  that  if  there  exists  an  efficient  solution  to  problem  (MOLP),  then  at  least  one 
extreme  point  efficient  solution  exists.  They  also  provided  a  test  for  the  efficiency  of  an 
extreme  point.  This  test  is  a  variant  of  a  similar  formulation  given  in  Philip  (1972)  for 
a  similar  purpose. 

Evans  and  Steuer  (1973a)  classified  multiple  objective  linear  problems  into  five 
mutually  exclusive  (and  jointly  exhaustive)  groups,  and  they  provided  results  to  identify 
the  group  to  which  a  particular  multiple  objective  programming  problem  belongs.  They 
then  presented  a  sequential  maximization  technique  which  either  yields  an  efficient 
extreme  point,  if  one  exists,  or  terminates  with  the  indication  that  the  efficient  set  is 
empty. 
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The  algorithm  of  Evans  and  Steuer  is  a  modification  of  the  simplex  method.  They 

also  provided  results  of  some  computational  experiments  in  which  they  analyzed  and 

compared  four  different  options  for  implementing  their  algorithm.    In  some  of  these 

options,  they  incorporated  subproblem  tests  into  the  revised  simplex  algorithm.    These 

subproblem  tests  are  utilized  in  testing  the  transient  extreme  points  generated  during  the 

implementation  of  the  simplex  method  to  see  if  they  are  efficient  or  not.    Their  results 

show  that  frequent  calls  to  subproblem  tests  worsen  the  computational  performance  of 

the  procedure. 

One  important  conclusion  that  can  be  drawn  from  these  experiments  is  that  the 
average  computational  time  increases  as  the  number  of  criteria  increases.  The 
procedures  in  Evans  and  Steuer  (1973a),  as  presented,  do  not  incorporate  techniques  to 
handle  degeneracy  in  these  problems. 

Evans  and  Steuer  (1973b)  presented  two  revised  simplex,  subproblem-oriented 
algorithms.  Each  algorithm  first  finds  an  efficient  extreme  point,  then  enumerates  all 
remaining  efficient  extreme  points.  The  first  algorithm  is  an  adjacent  efficient  extreme 
point  method  which  involves  the  examination  of  the  efficiency  of  all  edges  emanating 
from  a  given  extreme  point.  The  second  algorithm  is  an  adjacent  efficient  basis  method 
which  involves  pivoting  among  the  set  of  all  efficient  bases.  Although  the  first  algorithm 
is  structured  to  deal  with  degeneracy,  the  second  is  not. 

Later,  Yu  and  Zeleny  (1975)  concentrated  on  the  problem  of  finding  the  set  of 
all  nondominated  solutions  associated  with  problem  (MOLP).  They  showed  that  the  set 
of  all  dominated  solutions  is  convex  and,  when  X  is  compact,  that  the  set  of  all 
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nondominated  solutions  is  a  subset  of  the  convex  hull  of  the  nondominated  extreme 

points.    They  also  showed  that  the  set  of  nondominated  extreme  points  of  problem 

(MOLP)  is  connected,  i.e.  given  two  efficient  extreme  points,  an  ordered  set  of  adjacent 

efficient  extreme  points  exists  whose  first  element  is  one  of  the  points  and  whose  last 

element  is  the  other  point. 

Yu  and  Zeleny  next  defined  the  faces  of  a  polyhedron  incident  to  a  particular 
extreme  point  as  a  function  of  the  set  of  nonbasic  indices  at  that  extreme  point.  In 
addition  to  a  decomposition  theorem,  they  derived  some  necessary  and  sufficient 
conditions  for  a  face  to  be  nondominated. 

Based  on  these  results,  Yu  and  Zeleny  presented  two  methods.  Their  first  method 
is  a  multicriteria  simplex  method  which  identifies  all  nondominated  extreme  points  of 
problem  (MOLP).  For  simplicity,  their  method  assumes  that  the  feasible  region  is 
compact  and  nondegenerate. 

Their  second  method  focused  on  the  problem  of  generating  the  entire  set  of 
nondominated  solutions.  This  method  consists  of  systematically  obtaining  efficient 
extreme  points  and  investigating  faces  of  decreasing  dimension  incident  to  these  points 
in  order  to  identify  efficient  ones. 

Ecker  and  Kouada  (1978)  presented  an  algorithm  for  finding  all  of  the  efficient 
extreme  points  of  problem  (MOLP).  They  provided  a  characterization  for  the  efficiency 
of  an  edge  incident  to  an  efficient  extreme  point.  Their  algorithm  utilizes  this 
characterization  to  obtain  all  of  the  efficient  extreme  points  of  X. 
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Ecker  and  Kouada  (1976)  also  provided  useful  results  to  characterize  efficient 

faces.  A  face  is  called  maximally  efficient  if  there  exists  no  other  higher  dimensional 
efficient  face  that  contains  it.  They  developed  an  algorithm  called  FACE  to  find  all 
maximally  efficient  faces  incident  to  a  given  vertex  of  the  feasible  region  of  problem 
(MOLP)  under  the  assumption  of  nondegeneracy.  In  the  algorithm  FACE,  first,  efficient 
edges  incident  to  the  given  vertex  are  isolated.  Since  these  are  the  only  edges  that  can 
possibly  belong  to  efficient  faces  containing  the  vertex,  the  effort  involved  in  checking 
all  possible  faces  incident  to  the  given  vertex  for  efficiency  is  avoided.  Algorithm  FACE 
then  sequentially  constructs  efficient  faces  incident  to  the  vertex,  each  one  a  proper 
subset  of  its  successor,  until  a  maximal  efficient  face  is  obtained.  Then,  other  maximal 
efficient  faces  are  obtained  by  backtracking. 

Later,  Ecker,  Hegner  and  Kouada  (1980)  combined  algorithm  FACE  with  the 
algorithm  of  Ecker  and  Kouada  (1978).  In  this  way,  they  developed  an  algorithm  for 
generating  all  maximal  efficient  faces  for  problem  (MOLP).  In  Ecker,  Hegner  and 
Kouada  (1980),  a  maximal  face  is  characterized  as  the  optimal  solution  set  for  a 
particular  linear  program. 

Isermann  (1977)  used  a  dual  approach  to  multiparametric  linear  programming  in 
order  to  identify  all  efficient  solutions  of  problem  (MOLP).  The  procedure  he  proposed 
first  identifies  all  efficient  extreme  points  and  efficient  extreme  directions  of  problem 
(MOLP).  The  set  of  all  efficient  solutions  is  then  determined  as  a  union  of  a  minimal 
number  of  convex  sets  of  efficient  solutions. 
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All  the  methods  that  we  have  reviewed  so  far  attempt  to  identify  all  efficient 

extreme  point  solutions  to  problem  (MOLP).  The  set  presented  to  the  DM  is  either  the 
set  of  all  efficient  extreme  points,  or  the  set  of  all  maximally  efficient  faces  characterized 
in  certain  ways.  Starting  from  an  initial  efficient  extreme  point  solution  (see  for 
instance,  Ecker  and  Hegner  1978,  Benson  1981,  Benson  1991a  for  finding  an  initial 
efficient  extreme  point  solution),  other  efficient  extreme  points  are  obtained  by  certain 
pivoting  operations.  Since  the  set  of  efficient  extreme  points  of  problem  (MOLP)  is 
connected,  a  path  is  traversed  along  efficient  extreme  points,  and  some  bookkeeping 
procedures  are  employed  in  an  effort  to  enhance  practicality.  To  generate  efficient  faces, 
special  subproblems  are  used.  All  of  these  procedures  are  organized  into  an  accounting 
scheme  in  order  to  make  the  techniques  implementable. 

One  general  difficulty  that  arises  in  all  of  these  procedures  is  degeneracy.  It  is 
well-known  that  several  bases  can  be  assigned  to  a  single  degenerate  vertex.  Since  all 
of  these  methods  use  the  notion  of  a  basic  feasible  solution  to  characterize  the  vertices 
of  the  feasible  region,  the  task  of  determining  the  set  of  all  efficient  vertices  becomes 
more  complicated  when  degeneracy  is  present.  Murty  (1985)  showed  that  the  standard 
methods  of  perturbation  or  lexicographic  order  may  not  suffice  to  overcome  the 
difficulties  that  arise  in  the  presence  of  degeneracy.  He  then  provided  a  generalization 
of  the  representation  of  faces  of  a  polyhedron  in  an  effort  to  eliminate  the  complications 
caused  by  degeneracy.  His  proposed  method  is  a  modification  of  the  Ecker,  Hegner, 
Kouada  algorithm  ( 1980)  and  provides  a  framework  for  obtaining  all  of  the  efficient  faces 
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incident    to    a    degenerate    extreme    point.    However,    the    task    still    remains    a 

computationally-proliibitive  one. 

As  an  alternative  to  the  pivoting  based  approaches.  Gal  (1977)  proposed  a 
procedure  that  relies  on  multiparametric  linear  programming.  His  method  eliminates  the 
need  for  explicit  treatment  of  degeneracy  and  unbounded  feasible  regions.  However, 
solving  the  associated  multiparametric  linear  programs  may  have  heavy  computational 
requirements. 

In  a  more  recent  study,  Armand  and  Malivert  (1990)  developed  a  two-step  method 
for  finding  the  set  of  efficient  solutions  of  problem  (MOLP).  They  gave  special  pivoting 
rules  in  order  to  avoid  generating  all  of  the  bases  that  correspond  to  a  degenerate 
efficient  vertex.  Their  method  first  finds  all  of  the  efficient  extreme  points.  Then,  by 
a  combinatorial  process,  faces  incident  to  each  of  these  vertices  are  constructed,  and 
maximally  efficient  faces  are  identified. 

Later,  Armand  (1990)  presented  another  method  m  which  a  local  approach  is 
employed  in  order  to  reduce  the  computafional  effort  required  by  the  combinatorial 
process  in  Armand  and  Malivert  (1990).  Although  this  method  practically  outperforms 
the  previous  one,  the  results  display  a  significant  increase  in  computational  time  when 
degeneracy  is  encountered. 

To  summarize,  the  vector  maximization  algorithms  for  problem  (MOLP)  generally 
seek  to  identify  all  of  the  efficient  extreme  points,  or  all  of  the  efficient  faces  of  X.  In 
that  respect,  they  are  designed  to  convey  the  maximum  information  to  the  DM.  This 
contrasts  with  the    methods  that  use  prior  and  progressive  articulation  of  the  DM's 
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preferences.       However,    this   is   not   necessarily   an   advantage.      Apart   from   the 

computational  burden  of  employing  these  methods,  and  the  complications  induced  by  the 
presence  of  degeneracy,  there  are  a  number  of  other  problems  associated  with  vector 
maximization  algorithms. 

a)  The  information  being  presented  to  the  DM  is  usually  overwhelming. 

b)  When  the  set  of  all  efficient  solutions  is  obtained,  presenting  these  to  the  DM  in  a 
form  that  would  make  it  easy  to  understand  is  difficult. 

c)  The  number  of  efficient  extreme  points  of  X  may  grow  considerably  as  a  function  of 
problem  size  (Dauer  1990).  Therefore,  even  approaches  that  only  generate  the  set  of 
efficient  extreme  points  of  X  can  overwhelm  the  DM. 

d)  The  set  of  all  efficient  extreme  points  may  not  constitute  a  good  representation  of  the 
efficient  set  (cf.  Section  1.3). 

The  factors  that  are  listed  above  have  raised  the  issue  of  finding  a  better 
representation  of  X^.    We  will  discuss  this  issue  in  more  detail  in  Section  2.3.4. 
2.3.3.    Optimizing  a  Linear  Function  Over  the  Efficient  Set  of  Problem  (MOLP) 

Problem  (P),  the  problem  of  optimizing  a  linear  function  over  the  efficient  set  Xg 
of  problem  (MOLP),  was  introduced  by  Philip  (1972).  Problem  (P)  arose  at  least 
partially  in  response  to  some  of  the  difficulties  involved  in  using  problem  (MOLP)  as  a 
decision  aid.  By  solving  problem  (P)  instead  of  problem  (MOLP),  the  computational 
burden  of  generating  all  of  X,.  or  all  of  the  extreme  points  of  X^  is  avoided  (Ecker  and 
Kouada  1978,  Isermann  1977,  Yu  and  Zeleny  1975).  Moreover,  since  problem  (P)  yields 
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only  one  efficient  point,  the  danger  of  possibly  overwhelming  the  decision  maker  with 

large  numbers  of  efficient  points  to  choose  from  is  precluded. 

Mathematically,  a  special  case  of  problem  (P)  is  problem  (PD),  where  d  =  w^C 
for  some  w  €  Rf.      In  particular,  when  d  =  -c,  for  some  i  €  {l,2,...,p},  problem 
(PD)  seeks  the  minimum  value  of  the  objective  function    <c„x  >  over  the  efficient  set 
of  problem  (MOLP).  The  fact  that  problem  (P)  can  be  specialized  to  solve  the  problem 
of  minimizing  an  objective  function     <Ci,x>     of  problem  (MOLP)  over  Xg  serves 
several  useful  purposes  of  its  own  in  multiple  criteria  decision  making.    The  optimal 
value  of  this  problem,  along  with  the  maximum  value  of  the  same  objective  function  over 
Xe,  defines  the  range  of  values  that    <c,,x  >    takes  over  X,.  .  Knowledge  of  this  range 
aids  the  decision  maker  in  setting  goals,  evaluating  points  in  Xg  and  ranking  objective 
functions  (Isermann  and  Steuer  1987).  Furthermore,  by  obtaining  the  points  that  achieve 
the  minimum  and  the  maximum  values  of  the  objective  functions  over  Xe,  a  discrete 
representation  of  X^,  albeit  very  sparse,  is  obtained. 

Since  Xe  is  generally  a  nonconvex  set,  problem  (P)  can  be  classified  as  a  global 
optimization  problem.  It  is  well  known  that  such  problems  possess  local  maxima  which 
need  not  be  globally  maximal.  Moreover,  the  number  of  local  maxima  may  increase 
considerably  as  the  number  of  variables  in  a  global  optimization  problem  increases. 
Therefore,  global  optimization  problems  are  much  more  difficult  to  solve  than  convex 
programming  problems. 
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In  spite  of  the  importance  of  problem  (P),  only  a  few  procedures  have  been 

proposed  for  globally  solving  it.  This  might  be  partially  due  to  the  inherent  difficulty 
of  finding  a  global  maximum  for  the  problem. 

The  first  method  to  be  propx)sed  for  optimally  solving  problem  (P)  was  given  by 
Philip  (1972).  As  part  of  a  larger  study  of  problem  (MOLP),  Philip  briefly  outlined  a 
cutting  plane  procedure  for  solving  problem  (P).  Later,  the  same  procedure  was  given 
by  Isermann  and  Steuer  (1987)  for  the  special  case  of  minimizing  an  objective  function 
of  problem  (MOLP)  over  X^.  In  both  algorithms,  each  time  a  cutting  plane  is 
introduced,  it  is  necessary  to  search  along  the  intersection  of  the  cutting  plane  and  the 
current  feasible  polyhedron  for  all  newly-created  extreme  points.  Since  no  mathematical 
procedure  is  given  to  describe  how  to  perform  this  search,  it  is  not  clear  how  to,  or 
whether  it  is  possible  to,  implement  these  algorithms. 

Isermann  and  Steuer  (1987)  proposed  another  algorithm  for  minimizing  an 
objective  function  over  the  efficient  set.  Their  algorithm  requires  solving  mathematical 
programs  that  contain  nonconvex  quadratic  constraints. 

Benson  (1984)  studied  vanous  aspects  of  problem  (P).  He  derived  necessary  and 
sufficient  conditions  for  problem  (P)  to  be  unbounded.  He  also  elaborated  certain 
properties  of  the  optimal  solution  set  of  problem  (P).  Specifically,  the  results  given  by 
Benson  concerning  polyhedral  feasible  regions  suggest  potential  computational 
procedures  for  tmding  an  optimal  solution  to  the  problem. 
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More  recently,   Benson  proposed   three  algorithms  for  solving  problem   (P) 

(1991b,  1992,  1991c).  These  algorithms  are  all  finite  and  can  be  implemented  using  only 

linear  programming  techniques. 

The  first  implementable  algorithm  for  solving  problem  (P)  given  by  Benson 

(1991b)  actually  solves  an  infinitely-constrained  problem  which  is  equivalent  to  problem 

(P).  His  algorithm  uses  relaxation  to  solve  this  problem.  The  algorithm  stops  either  with 

an  extreme  point  or  non-extreme  point  optimal  solution  for  the  problem  after  a  finite 

number  of  iterations. 

The  second  algorithm  proposed  by  Benson  (1992)  is  an  extreme  point  search 

algorithm.  In  the  initial  step  of  the  algorithm,  an  initial  efficient  extreme  pomt  is  found. 
Then,  m  each  iteration,  an  improved  efficient  extreme  point  is  found  which  is  distinct 
from  all  previously-obtained  efficient  points.  This  new  point  need  not  be  adjacent  to  the 
point  obtained  in  the  previous  iteration.  The  algorithm  finds  a  globally  opfimal  extreme 
point  solution  for  problem  (P)  in  a  finite  number  of  iterations. 

The  third  algonthm  proposed  by  Benson  (1991c)  is  designed  for  problem  (PD). 
The  algorithm  uses  a  bisection  search  to  find  progressively  smaller  intervals  of  the  real 
number  line  that  contain  the  optimal  value  of  problem  (PD).  For  each  value  of  the 
parameter  chosen  during  the  bisection  search,  a  convex  maximization  problem  over  X 
is  solved.  Depending  upon  the  value  of  the  objective  function  of  the  convex 
maximization  problem,  an  ordinary  local  optimum  search  procedure  may  be  invoked  in 
some  iterations  of  the  bisection  algorithm.    The  algorithm  terminates  with  an  extreme 
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point  optimal  solution  for  problem  (PD)  in  a  finite  number  of  steps,  provided  that  a  finite 

algorithm  is  employed  to  solve  the  convex  maximization  subproblems. 

Although  these  algorithms  are  promising  and  have  various  advantages,  they  suffer 
from  the  requirement  of  solving  certain  nonconvex  optimization  problems  in  each 
iteration. 

Heuristic  algorithms  that  are  proposed  to  approximate  a  global  optimal  solution 
for  problem  (P)  are  quite  sparse.  Dessouky,  Ghiassi  and  Davis  (1986)  presented  three 
heuristic  algorithms  for  the  special  case  of  minimizing  an  objective  function  over  the 
efficient  set.  Their  procedures  suggest  initiating  one  of  the  search  procedures  for 
globally  solving  problem  (P),  but  terminating  it  prematurely  with  a  locally  optimal 
solution.  One  of  these  procedures  is  complicated  by  the  requirement  of  finding  good 
solutions  to  certain  bilinear  programming  problems. 

Dauer  (1991)  proposed  a  heuristic  algorithm  for  solving  problem  (P).       His 

algorithm  attempts  to  find  a  local  optimal  solution  by  searching  adjacent  efficient  faces 

of  X  using  an  active  constraint  approach. 

2.3.4.   An  Overview  of  Methods  for  Finding  A  Discrete  Representation  of  the  Efficient 
Set 

Among  the  three  main  categories  of  approaches  that  we  have  reviewed  so  far, 

methods  that  use  prior  articulation  of  the  DM's  preferences  have  been  the  least  favored. 

Methods   in   this  category   usually   suffer  from   making   restrictive  assumptions,   or 

demanding  too  much  information  from  the  DM.    Hence,  methods  that  use  progressive 

or  posterior  articulation  of  the  DM's  preferences  have  been  the  most  studied.   However, 
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both  types  of  approaches  have  certain  advantages  and  disadvantages.     Thus  neither 

category  of  methods  dominates  the  other. 

In  general,  interactive  methods  presuppose  an  arbitrary  degree  of  accuracy  in  the 
DM's  responses,  usually  rely  on  arbitrary  rules,  and  fail  to  provide  sufficient  information 
to  the  DM.  On  the  other  hand,  vector  maximization  algorithms  usually  concentrate  on 
solving  problem  (MOLP),  require  heavy  computations,  and  have  the  risk  of 
overwhelming  the  DM  by  the  abundance  of  efficient  points  being  generated.  Towards 
this  end,  obtaining  a  good  discrete  representation  of  the  efficient  set  of  problem  (MMP) 
would  eliminate  the  problems  associated  with  both  types  of  approaches. 

A  discrete  representation  of  X^  obtained  by  the  vector  maximization  algorithms 
reviewed  in  Section  2.3.2.2  is  the  set  of  all  efficient  extreme  points  of  problem  (MOLP). 
However,  aside  from  the  heavy  computational  burden  of  generating  all  the  efficient 
extreme  points,  this  is  not  a  very  desirable  representation.  The  efficient  extreme  points 
being  presented  to  the  DM  may  not  be  well-dispersed,  and  thus  may  not  constitute  a  good 
representation. 

It  becomes  evident  from  the  above  discussions  that  a  "good"  representation  of  the 
efficient  set  of  problem  (MOLP)  should  possess  certain  properties,  such  as  being  well- 
dispersed  and  having  a  relatively-small  cardinality.  Clearly,  it  would  be  preferable  to 
attain  this  representation  with  a  reasonable  amount  of  computational  effort.  Thus 
efficiently  finding  a  good  discrete  representation  of  X^  would  constitute  a  practical  way 
for  providing  the  DM  with  sufficient  information  for  choosing  a  most  preferred  solution. 
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In  this  way,  an  approach  of  seeking  a  good  discrete  representation  of  Xg  could  combine 

the  best  properties  of  progressive  and  posterior  approaches. 

The  problems  associated  with  the  solutions  obtained  by  a  vector  maximization 
algorithm  have  been  noticed  by  a  few  authors.  Some  suggestions  have  been  made  in 
order  to  remedy  at  least  some  of  the  disadvantages  of  vector  maximization  algorithms. 

One  way  of  overcoming  the  difficulty  associated  with  the  vector  maximization 
approach  is  assigning  positive  weights  to  the  objective  functions  of  problem  (MOLP)  and 
solving  the  resulting  single  objective  linear  program.  This  can  also  be  regarded  as  a 
special  case  of  the  multiattribute  utility  theory  idea  (Keeney  and  Raiffa  1976).  This 
method  would  generate  only  one  efficient  extreme  point.  However,  finding  an  accurate 
estimate  of  the  weights  that  would  yield  the  DM's  most  preferred  solution  is  not  easy. 
Hence  this  approach  does  not  provide  a  desirable  representation  (see,  for  instance, 
Eckenrode  1965,  Steuer  1986  and  references  therein). 

In  an  attempt  to  reduce  the  number  of  efficient  extreme  points  obtained,  Steuer 
(1976a)  suggested  assigning  interval  criterion  weights  to  the  objective  functions  of 
problem  (MOLP).  In  this  method,  interval  estimates  of  weights  are  determined  rather 
than  point  estimates.  Steuer  gave  a  procedure  that  involves  converting  the  multiple 
objective  linear  programming  problem  with  interval  criterion  weights  into  an  equivalent 
vector  maximization  problem.  The  set  of  all  the  efficient  extreme  points  of  the  converted 
problem  comprises  a  subset  of  the  set  of  all  efficient  extreme  points  of  the  original 
problem.  Since  this  procedure  requires  finding  all  the  efficient  extreme  points  of  the 
converted  problem,  it  resembles  the  methods  discussed  in  Section  2.3.2.2.  In  particular, 
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its  computational  requirements  are  heavy,  and  the  solutions  generated  for  problem 

(MOLP)  consists  of  extreme  points.  Thus  the  solutions  being  presented  to  the  DM  may 
not  constitute  a  good  representation  of  Xg. 

In  an  attempt  to  obtain  a  small  sample  of  efficient  points  with  well-dispersed 
locations,  Steuer  introduced  a  filtering  technique  (Steuer  1976b,  Steuer  and  Harris  1980, 
Steuer  1986).  Prior  to  the  application  of  this  technique,  first  either  the  set  of  all  efficient 
extreme  points  or  a  subset  of  this  set  is  obtained.  Then  an  appropriate  distance  function 
is  chosen.  Filtering  is  then  used  to  eliminate  some  of  the  points  in  this  sample  based  on 
the  distances  between  various  pairs  of  points. 

Filtering  fails  to  be  an  ideal  method  for  obtaining  a  discrete  representation,  mainly 
because  the  computational  effort  to  generate  all  of  the  efficient  extreme  points  is  not 
reduced.  Moreover,  the  sample  of  points  obtained  prior  to  filtering  may  not  be  itself 
representative  of  X^.  Depending  on  the  geometry  of  the  feasible  region,  some  of  the 
efficient  extreme  points  may  be  clustered  together,  while  others  may  be  quite  distant 
from  one  another.  In  that  case,  the  filtering  procedure  would  generate  a  sparse  set  of 
points,  with  no  representation  of  the  efficient  points  "in-between,"  i.e.  the  non-extreme 
efficient  solutions. 

Morse  (1980)  and  Torn  (1980)  independently  suggested  using  clustering  for 
reducing  the  size  of  the  efficient  extreme  points  being  presented  to  the  DM.  They 
suggest  using  cluster  analysis  to  construct  partitions  of  the  set  of  efficient  extreme  points 
into  groups  of  relatively  homogeneous  elements.  However,  all  of  the  disadvantages 
related  to  filtering  are  valid  for  clustering  also. 
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All  of  these  methods  are  significant  in  MCDM  since  they  have  the  goal  of 

portraying  the  efficient  set  by  a  representative  subset.  However,  they  fail  to  be  adequate 
as  a  solution  procedure,  or  as  part  of  a  solution  procedure  for  problem  (MMP).  Some 
common  disadvantages  associated  with  these  methods  can  be  stated  as  follows. 

a)  The  methods  concentrate  on  problem  (MOLP). 

b)  The  methods  generally  require  as  many  or  more  calculations  than  the  procedures 
developed  for  obtaining  all  of  the  efficient  extreme  points  of  X. 

c)  The  efficient  solutions  being  presented  to  the  DM  still  consist  of  extreme  points. 
Thus,  the  quality  of  the  representative  subset  of  efficient  points  obtained  may  not  be 
satisfactory  (cf.  Section  1.3). 

All  of  these  factors  suggest  that  alternative  procedures  for  obtaining  representative 
samples  of  efficient  solutions  should  be  developed. 

2.4.  Theoretical  Background  and  Notation 

In  this  section,  we  will  present  some  of  the  background  theory  that  is  used  in  the 
development  of  the  procedures  in  this  dissertation.  These  results  have  been  widely 
utilized  in  multiple  objective  mathematical  programming.  We  will  also  establish  some 
notation  that  will  be  used  throughout  the  dissertation.  For  simplicity,  we  will  restrict  our 
attention  to  the  multiobjective  convex  programming  problem,  (MOCP),  given  by 

(MOCP)  VMAX  Cx,        s.t.  X  6  X, 

where  X  ^  R"  is  a  compact,  convex  set,  and  C  is  the  pxn  matrix  of  objective  function 
coefficients.  Let  Y  =  {Cx|  x  G  X}.  Then  Y  is  a  compact,  convex  set  (Rockafellar 
1970). 
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To  help  analyze  problem  (MOCP),  we  will  sometimes  study  a  transformed 

problem  in  the  objective  function  space  which  can  be  written 

(MOCPY)  VMAX  I^y,        s.t.  y6Y, 

where  Ip  is  the  p  xp  identity  matrix.  Let  Xg  denote  the  efficient  set  of  problem  (MOCP), 

and  let  Y^  denote  the  efficient  set  of  problem  (MOCPY).  The  following  lemma  provides 

the  basis  for  the  equivalance  of  problem  (MOCP)  and  problem  (MOCPY). 

Lemma  2.4.1.  (a)   For  any  y°  E  Y^,  if  x°  G  X  satisfies  Cx°  =  y°,  then  x°  G  Xg. 
(b)   For  any  x°  G  X^,  if  y°  -  Cx°,  then  y°  G  Y^. 
Proof.    Both  (a)  and  (b)  follow  easily  from  the  definitions  of  Xe  and  Y^.         ■ 
Let  A  =  {X  G  R*"!  <e,X>    <  M,  X  ^  e},  where  e  G  R*"  is  a  vector  whose 

entries  each  equal  one,  and  M  is  a  positive  real  number.   Let  Y=  =  {y  G  R''|y  <  y  for 

some  y  G  Y}. 

For  a  given  y  G  Y^  and  X  G  A,  we  will  also  need  to  study  the  problem  (P^  J 

given  by 


(Py.>) 


max     <X^C,x>, 
s.t. 

-Cx  ^  -y,  (2.1) 

xGX. 


This  problem  and  variations  of  it  have  been  widely  used  in  various  studies  of  problem 
(MMP).  The  following  results  establish  two  properties  of  problem  (Py  .J  that  we  will 
find  useful.   The  proofs  follow  easily  from  Theorems  3.1  and  3.2  in  Benson  (1978). 
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Theorem  2.4. 1.     Assume  that  x"  G  R"  and  let  y  =  Cx".   Then  x"  belongs  to  Xg  if  and 

only  if  x°  is  an  optimal  solution  for  problem  (Py  J  for  every  X  G  A. 

Theorem  2.4.2.    If  y  G  Y-    and  X  G  A,  then  problem  (Py  J  has  at  least  one  optimal 

solution,  and  any  optimal  solution  x"  for  problem  (Pyx)  satisfies  x°  G  X^. 

Another  widely-utilized  problem  is  the  "weighted  sum"  problem 
(Px)  max  <X^C,x>,    subject  to  x  G  X, 

where  X  G  A. 

Theorem  2.4.3.  Suppose  that  X  is  a  polyhedron.  For  sufficiently  large  M,  a  point  x° 
belongs  to  Xg  if  and  only  if  there  exists  at  least  one  X°  G  A  such  that  x°  is  an  optimal 
solution  to  problem  (PJ  with  X  =  X°. 

We  will  assume  henceforth  that  M  is  chosen  to  be  large  enough  to  guarantee  this 
property. 

When  X  is  a  polyhedron,  it  is  well-known  that  the  efficient  set  for  problem 
MOLP  can  be  described  by 

Xe  =  U  {X,|X  G  A}  (2.2) 

where  A  is  a  finite  subset  of  A,  and  for  each  X  G  A,  X^  denotes  the  optimal  solution  set 
of  the  linear  program  (PJ  (Yu  and  Zeleny  1975).  Since  the  optimal  solution  set  of  a 
linear  program  is  a  face  of  its  polyhedral  constraint  set,  this  implies  that  Xg  is  a  union 
of  a  finite  number  of  faces  Xx,  X  G  A,  of  X.  However,  the  representation  of  X^  as 
given  in  (2.2)  is  not  generally  unique. 
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Another  important  property  of  problem  (MOLP)  is  that  the  extreme  points  of  X 

that  lie  in  X^  comprise  a  connected  set  (Yu  and  Zeleny  1975,  Yu  1985),  where 
connectedness  is  defined  in  the  following  sense: 

Definition  2.4.1.  A  subset  Q  of  the  extreme  points  of  a  polyhedron  is  said  to  be 
^"""^^^^  when,  for  any  two  elements  x"  and  x'  of  Q,  there  is  a  set  of  elements 
x',  x^...,x■-'  of  Q  such  that,  for  i  =  0,l,..,t-l,  x'  is  adjacent  to  x'*'. 

Let  Z  denote  a  convex  set  in  R",  Q  a  discrete  set  in  R\  and  let  z',  z^  €  R*".   Let 

r  e  R.    Then  we  define  the  following  notation. 

(int  Z)  :  interior  of  Z, 

d(Z)  :  boundary  of  Z, 

Zex  :  the  set  of  extreme  points  of  Z, 

Z-  :  {z  e  R-ijz  <  i  for  some  z  E  Z}, 

z'  >  z^  :  z'  >  z'  and  z'  ^  z\ 

II  z'  II  :  Euclidean  norm  of  z', 

|r|  :  absolute  value  of  r, 

IQI  :  cardinality  of  Q. 

We  will  assume  that  z'  G  RMs  a  column  vector.    We  will  use  the  notation  (z')^ 

to  denote  the  transpose  of  z'.    When  it  is  clear  from  the  contents  that  (z')^  is  a  row 
vector,  we  will  simply  use  z'  instead  of  (z')^. 


CHAPTER  3 

OPTIMIZATION  OVER  THE  EFFICIENT  SET: 
TOWARDS  AN  EXACT  ALGORITHM 

The  work  of  this  chapter  originates  from  problem  (PD).  The  problem  of 
minimizing  one  of  the  objective  functions  of  problem  (MOLP)  over  the  efficient  set 
constitutes  a  special  case  of  problem  (PD).  This  special  case  of  problem  (PD)  may 
significantly  aid  in  finding  a  discrete  representation  of  Xg  (cf.  Section  1.4). 

Benson  (1991c)  proposed  a  finite  bisection-extreme  point  search  algorithm  for 
solving  problem  (PD).  His  algorithm  requires  repeated  solutions  of  certain  convex 
maximization  subproblems.  This  requirement  is  one  of  the  motivations  for  the  work  we 
will  present  in  this  chapter.  Another  is  the  need  to  develop  more  efficient  algorithms  for 
the  problem  of  minimizing  a  concave  function  over  a  polyhedron. 

In  this  chapter  we  present  an  exact,  finite  branch  and  bound  algorithm  for 
minimizing  a  concave  function  over  a  compact  polyhedron.  The  algorithm  uses  a  process 
that  we  call  neighbor  generation  to  ensure  implementability  and  convergence. 

In  Section  3.1.  we  will  describe  the  algorithm  given  in  Benson  (1991c).  In 
Section  3.2,  we  will  present  a  brief  overview  of  concave  minimization  algorithms. 
Section  3.3  will  contain  the  theoretical  background  required  for  the  development  of  the 
new  algorithm.    The  algorithm  will  be  presented  in  Section  3.4.    In  Section  3.5,  the 
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validity  and  finiteness  of  the  algorithm  will  be  shown.    A  discussion  of  computational 

benefits  and  some  computational  results  will  follow  in  Section  3.6. 

3.1.    The  Bisection-Extreme  Point  Search  Algorithm 

In  this  section,  we  will  give  a  brief  description  of  the  Bisection-Extreme  Point 
Search  Algorithm  of  Benson  (1991c).  A  thorough  understanding  of  the  Bisection- 
Extreme  Point  Search  Algorithm  is  not  crucial  for  the  development  of  the  concave 
minimization  algorithm  that  constitutes  the  major  work  in  this  chapter.  Therefore,  we 
will  only  include  the  portions  of  the  background  theory  given  in  Benson  (1991c)  that  are 
necessary  to  help  motivate  the  concave  minimization  algorithm.  The  reader  is  referred 
to  Benson  (1991c)  for  details. 

Let  X  =  {xER"  I  Ax  <  b,  x  >  0}  be  a  nonempty  compact  polyhedron,  where 
A  is  mxn  and  bGR".    The  following  result  gives  a  fundamental  property  of  problem 
(P). 
Theorem  3. 1.1.    Problem  (P)  has  an  optimal  solution  which  belongs  to  X,,. 

Eiool  Since  X  is  nonempty  and  compact,  X^  is  also  nonempty  and  compact 
(Ecker  and  Kouada  1975,  Yu  and  Zeleny  1975).  Therefore,  problem  (P)  has  at  least  one 
optimal  solution.  In  addition,  from  Rockafellar  (1970),  the  compactness  of  X  implies 
that  X  has  no  lines.  From  Theorem  4.5  in  Benson  (1984),  it  follows  that  problem  (P) 
has  at  least  one  optimal  solution  that  belongs  to  X„.  ■ 

The  Bisection-Extreme  Point  Search  Algorithm  finds  an  optimal  solution  to 
problem  (PD)  that  belongs  to  X^OXe  in  a  finite  number  of  iterations.    The  algorithm 
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uses  the  following  result  to  solve  problem  (PD).   The  proof  of  this  result  can  be  found 

in  Benson  (1991c). 

Theorem  3.1.2.    There  exists  a  positive  real  number  M  such  that  for  any  M>  M, 

Vj  =  t*,  where  t'  is  the  smallest  value  of  t  G  R  in  the  problem  (WJ  given  by 

TT,  =  max     <X,Cx>  -   <b,u>   -  tv, 
s.t. 

Ax  ^b, 

u^A  +  vd^"  -  X^C  ^0, 

<e,X>  =  M, 

X  >e, 

x,u,v  :^  0, 

such  that  X,  =  0. 

Notice  that  for  each  value  of  t,  problem  (WJ  is  a  bilinear  programming  problem. 

In  the  Bisection-Extreme  Point  Search  Algorithm,  a  bisection  search  is  used  to 

find  progressively  smaller  subintervals  of  the  real  number  line  of  the  form  [L,U]  that 

contain  v^.  For  each  t  E  [L,U]  chosen  during  the  bisection  search,  the  question  whether 

7r,>0  or  7r,=0,  where  t,  is  as  defined  in  Theorem  3.1.1,  must  be  answered.    When 

T,=0,  U  is  decreased  to  t.    When  ir,>0,  a  local  extreme  point  search  procedure  is 

invoked  to  update  L.  This  procedure  finds  a  new  incumbent  solution  x'   E  X„  O  Xg  that 

satisfies  <d,x'>  >  t.   Then  L  is  set  equal  to  <d,x'>.    Throughout  the  execution  of 

the  algorithm,  at  certain  times,  a  termination  test  is  required,  which  consists  of  testing 

whether  Xl  =  0  or  ttl  >  0.   When  ttl  =  0,  the  incumbent  solution  is  an  exact  optimal 

solution  for  problem  (PD). 
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Notice  that  the  Bisection-Extreme  Point  Search  Algorithm  calls  for  determining 

whether  Xt  =  0  or  x,  >  0  for  various  values  of  t  found  during  the  search.     To 

accomplish  this,  a  concave  minimization  algorithm  can  be  used.    The  next  result  helps 

to  explain  how  this  can  be  done.    Let  t„  denote  the  optimal  value  of  the  linear  program 

min  <d,x>,  subject  to  x  6  X. 
Theorem  3. 1..3.   Let  t  6  R  satisfy  t  >  t„,  and  assume  that  M  >  max{k,M},  where  M 
is  chosen  as  in  Theorem  3.1.2.  Then  the  value  of  t,  in  problem  (WJ  equals  the  optimal 
value  of  problem  (VJ  given  by 

max  ht(x),  subject  to   x  G  X, 
where  h,:R°-^R  is  the  continuous  piecewise  linear  convex  function  defined  by 

h,(x)         =      max  <X,Cx>   -  <b,u>   -  tv, 
s.t. 

u  ^A  +  vd  ^  -  X^C  ^  0, 
<e,X>   =  M, 
X  >e, 
u,v  ^0, 

for  each  xER". 

From  Theorem  3.1.3,  it  follows  that  to  determine  whether  t,>0  or  t.^O  for  a 
given  t,  it  suffices  to  solve  problem  (VJ.  But  problem  (VJ  is  a  convex  maximization 
problem,  which  can  be  represented  as  a  concave  minimization  problem. 

As  suggested  in  Benson  (1991c),  there  are  a  number  of  concave  minimization 
algorithms  that  can  be  used  to  solve  the  subproblems  that  arise  during  the  implementation 
of   the    Bisection-Extreme    Point    Search    Algorithm.       However,    since    the    main 
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computational  burden  of  the  algorithm  consists  of  solving  the  convex  maximization 

problems,  the  efficiency  of  the  algorithm  to  be  used  is  important.  It  is  also  crucial  that 
the  concave  minimization  algorithm  used  to  solve  the  subproblems  be  finite.  Motivated 
by  this  fact,  we  now  develop  an  exact,  finite  branch  and  bound  algorithm  with  neighbor 
generation  for  minimizing  a  concave  function  over  a  compact  polyhedron.  Before  we 
proceed  with  the  development  of  the  algorithm,  we  will  present  a  brief  review  of  the 
algorithms  that  have  been  suggested  to  solve  the  concave  minimization  problem. 
3.2.    An  Overview  of  Concave  Minimization  Algorithms 

The  concave  minimization  problem  (CM)  can  be  stated  as  follows. 
(CM)  min  f(x),  subject  to  x6X, 

where  f :  D  ^  R  is  concave  on  D,  and  D  ^  R"  is  an  open  set  that  contains  X.    Let  f„^ 
denote  the  optimal  objective  function  value  of  problem  (CM). 

Problem  (CM)  has  been  the  focus  of  many  recent  studies.  Numerous  applications 
from  various  fields  lead  to  concave  minimization  problems.  Moreover,  several  other 
difficult  problems  of  interest,  such  as  the  zero-one  integer  linear  programming  problem, 
and  the  linear  fixed  charge  problem  can  be  written  in  the  form  of  problem  (CM).  For 
instance,  in  Section  3.1,  we  have  discussed,  in  greater  detail,  how  a  certain  bilinear 
programming  problem  can  be  formulated  as  a  concave  minimization  over  a  polyhedron. 

Although  it  is  well  known  that  problem  (CM)  has  an  optimal  solution  that  is  an 
extreme  point  of  X,  problem  (CM)  is  a  mathematically-difficult  problem  that  may  possess 
many  local  optimal  solutions.  Therefore,  special  procedures  are  required  for  solving  it. 
The  algorithms  that  have  been  developed  to  solve  problem  (CM)  are  generally  based 
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upon  cutting  planes,  extreme  point  ranking,  relaxation,  branch  and  bound  searches,  and 

combinations  of  these  approaches. 

Tuy  (1964)  proposed  a  cone  splitting  algorithm  in  which,  as  the  algorithm 
proceeds,  portions  of  the  feasible  region  are  eliminated  from  further  consideration  by 
certain  cuts.  These  cuts  have  come  to  be  known  as  "Tuy  cuts."  Later,  many  authors 
proposed  algorithms  that  use  cutting  planes.  Among  these  are  algorithms  of  Zwart 
(1974),  and  Majthay  and  Whinston  (1974),  which  are  finite  algorithms,  and  two 
algorithms  of  Cabot  (1974).  One  of  the  algorithms  presented  in  Cabot  (1974)  uses  a 
composite  approach  of  cutting  planes  and  extreme  point  ranking. 

Murty  (1968)  proposed  an  extreme  point  ranking  algorithm  for  solving  the  linear 
fixed  charge  problem.  Later,  Taha  (1973)  provided  a  generalization  of  this  procedure 
for  problem  (CM). 

Falk  and  Hoffman  (1976)  presented  a  relaxation  method  for  solving  problem 
(CM).  Their  algorithm  involves  successively  minimizing  underestimating  functions  of 
the  objective  function  over  relaxed  regions  that  contain  the  original  feasible  region. 
Other  relaxation  algorithms  are  given  by  Carillo  (1977),  Rosen  (1983),  and  Falk  and 
Hoffman  (1986). 

The  algorithms  that  incorporate  branch  and  bound  search  use  the  idea  of 
partitioning  the  feasible  region  into  smaller  subregions.  Then,  for  each  partition  element, 
a  lower  bound  for  the  minimum  of  the  objective  function  value  over  the  subregion  is 
computed.  The  branch  and  bound  procedures  may  differ  in  the  way  the  lower  bounds 
are  computed,  or  in  the  type  of  partition  elements  that  are  used  in  the  branching  process. 
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The  first  of  the  algorithms  that  use  a  branch  and  bound  search  was  given  by  Falk  and 

Soland  (1969).  The  algorithm  of  Falk  and  Soland  requires  the  objective  function  to  be 
separable.  A  modified  version  of  their  algorithm  is  presented  in  Soland  (1974).  Both 
of  these  algorithms  use  rectangles  as  partition  elements  and  are  guaranteed  to  find  an 
exact  optimal  solution  in  a  finite  number  of  steps.  Other  typical  partition  elements  that 
are  used  in  the  branching  process  are  simplices  (Horst  1976,  Benson  1985),  and  cones 
(Thoai  and  Tuy  1980). 

More  information  about  the  methods  available  for  solving  problem  (CM)  can  be 
found  in  Pardalos  and  Rosen  (1986),  Pardalos  and  Rosen  (1987),  Horst  (1990),  Horst  and 
Tuy  (1990). 

The  branch  and  bound-neighbor  generation  algorithm  is  partly  motivated  by 
previous  work  by  Soland  (1974),  Horst  (1976),  and  Benson  (1985).  However,  significant 
differences  exist,  and  the  convergence  of  the  algorithm  is  guaranteed  in  a  different  way. 

3.3.   Theoretical  Background 

We  will  start  with  the  following  well-known  definitions,  which  can  be  found,  for 
instance,  in  Horst  and  Tuy  (1990). 

Definition  3.3. 1.    Let  {v°,  v',...,v''}  be  (n-fl)  affinely  independent  points  in  R".  The 
convex  hull  of  {v",  v',...,v"},  denoted  CONV{v",  v',..,v°},  is  called  a  simplex  (iv 
simplex)  and  the  points  v°,  v ',..., v"  are  called  vertices  of  the  simplex. 
Definition  3.3.2.   Let  Z  g  R°,  1  a  finite  set  of  indices.  A  set  Q  =  {Z'|  iGI}  of  subsets 
of  Z  is  said  to  be  a  partition  of  Z  if 

z  =  u  z'' 

i6I 
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Z'flZJ  =  aZ'H^ZJ    V  i,jGI,  i?ij, 

where  dZ.  denotes  the  (relative)  boundary  of  Zj. 

Definition  3.3.3.   Let  S  be  an  n-simplex  with  vertex  set  V(S)  =  {v°,  v',...,v°}.  Choose 
a  point  w  G  S,  w  ^  V(S)  which  is  uniquely  represented  by 


w  =   Va_v'  ,     a,   >  0,  1=0,1, ..n,     Sa,  =  U 

i=0  1=0 


and  for  each  i  such  that  aj  >  0,  form  the  simplex  S'  obtained  from  S  by  replacing  the 
vertex  v'  by  w,  i.e., 

S'  =  CONV{v°,...,v'"',w,v'"",...,v"}.  The  set  of  all  simplices  S'  obtained  in  this  way  is 
called  a  radial  subdivision  of  S. 

The  algorithm  that  we  will  present  for  solving  problem  (CM)  finds  an  initial 
simplex  S'*  that  contains  X.  Throughout  the  implementation  of  the  algorithm,  a  collection 
of  subsimplices  of  S"  is  maintained.  The  collection  of  subsimplices  of  S°  is  obtained  by 
subdividing  S*^  and  subsimplices  of  S°  using  radial  subdivision  at  each  iteration.  By  the 
following  result,  the  collection  of  subsimplices  of  S°  obtained  in  this  way  is  a  partition 
ofS". 

Theorem  3.3.1.  The  set  of  subsets  S'  that  can  be  constructed  from  an  n-simplex  S  by  an 
arbitrary  radial  subdivision  forms  a  partition  of  S  into  n-simplices. 

Proof.    See  Proposition  IV.  1  in  Horst  and  Tuy  (1990). 

In  the  algorithm,  for  an  arbitrary  n-simplex  S  that  belongs  to  the  current  partition 
of  S°,  a  lower  bound  has  to  be  computed  for  f  over  SOX.    To  compute  this  lower 
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bound,  the  algorithm  finds  an  extreme  point  of  X  that  minimizes  the  convex  envelope  fg 

of  f  on  S  over  X,  where  the  convex  envelope  is  defined  as  follows. 

Definition  3. 3 .4.    Let  Z  ^  R°  be  a  convex,  compact  set,  and  assume  that  h  :Z-»R  is 

lower  semicontinuous  on  Z.    A  function  h^:  Z-»R  is  called  the  convex  envelope  of  h  on 

Z  when 

i)  hz  is  convex  on  Z, 

ii)        hz(x)  <  h(x)  for  all  x  €  Z, 

iii)        there  is  no  function  q:  Z^R  satisfying  i)  and  ii)  such  that  hz(x)  <  q(x)  for  some 

point  X  6  Z. 

It  is  well  known  that  the  convex  envelojje  of  a  concave  function  on  an  n-simplex 
is  an  affine  function  and  can  be  obtained  by  solving  a  system  of  linear  equations. 
However,  in  our  procedure  for  obtaining  a  lower  bound  for  f  over  S  n  X  for  a  given 
n-simplex  S,  we  will  compute  the  minimum  of  fs  over  X,  and  an  extreme  point  of  X  that 
achieves  this  minimum,  without  solving  a  system  of  linear  equations.  The  following 
result  is  crucial  in  the  development  of  this  procedure.  For  ease  of  presentation, 
henceforth  we  will  assume  that  X  is  of  the  form  X  =  {xGR°|    Ax  <  b},  where 


A  = 


A 
-I 


is  the  (m+n)xn  matrix   of  constraint  coefficients  and   nonnegativity 
restrictions,  and  b  G  R"""^"  is  given  by  b  = 


Theorem  3.3.2.  LetS  ^  D  be  any  n-simplex  with  vertices  v°,v',...,v'',  and  let  fs:  S^R 
be  the  convex  envelope  of  f  on  S.  Consider  the  linear  program  (PJ  given  by 
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min    fs(x), 
s.t.  X  e  X, 

and  the  linear  program  (P^)  given  by 


(P,)  min    52f(v')7-, 

i=0 

s.t. 

n        _  _ 

E(Av')7i  ^b, 


1=0 


Et.  =  1- 


i=0 

Let  r  denote  the  feasible  region  for  the  linear  program  (P^). 

n  n 

i)         If  7  G  r,  then  x  =  Y.yv'  belongs  to  X  and  f  (x)  =   Y.H'v')y  •    Conversely, 

i=0     '  ^  1=0  ' 

if 


X  G  X,  then  there  exists  a  unique  7  G  T  such  that  x  =  St  v''  which,  furthermore, 

i=0 

satisfies  f^(x)  =  i;f(v')7;- 

i=0 

n 

ii)         If  7  is  an  extreme  point  of  F,  then   x  =   LiV  is  an  extreme  point  of  X. 

1=0  ' 

n 

Conversely,  if  x  is  an  extreme  point  of  X,  then  the  unique  7  G  F  such  thatx  =   Y  7  v ' 

i=0    ' 

is  an  extreme  point  of  F. 

iii)       The  optimal  values  of  problems  (PJ  and  problem  (P^)  are  equal.    If  7*  is  an 

n 

optimal  solution  for  problem  (P^),  then  x  '   =  V  7^'  v '  is  an  optimal  solution  for  problem 
(PJ.    If  x'  is  an  optimal  solution  for  problem  (PJ,  then  the  unique  7'  G  F  such  that 

n 

X  •   =  ^7.'  V '  is  an  optimal  solution  for  problem  (P^). 


i=0 
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Proof,    i)    Assume  that  y  E  T.    Let  x  =   v-yv'-    Since   5^(Av')7.  <  b,  the 

1=0     '  1=0  ' 


definition  of  x  implies  that  Ax  <  b,  i.e.,  x  G  X.   From  Horst  and  Tuy  (1990),  fs  is  an 
affine  function  and  satisfies  fs(v')  =  f(v'),  i=0, 1,..,n.  Therefore,  from  the  definition  of 


X,    fs(x)  =  fsC^TiV)  =   ZTifsCV)  =   ZTif(v') 


=0  i=0  i=0 


To  show  the  converse  statement  in  i),  assume  that  x  G  X.  From  Definition 
3.3.1,  the  vectors  v",  i=0,l,..,n,  are  affinely  independent.  For  each  i=0,l,..,n,  form 
the  vector  w'  G  R°^'  whose  first  n  entries  equal  those  of  v'  and  whose  (n+  l)st  entry  is 
one.  Then  w',  i=0,l,..,nare  linearly  independent  vectors  in  R""^'.  Therefore,  they  form 
a  basis  for  R""^'.  Let  y  G  R°"^'  denote  the  vector  whose  first  n  entries  equal  these  of  x 
and  whose  (n4-l)st  entry  is  one.   Then,  since  y  G  R""^',  there  exists  a  unique  y  G  R""^' 

n  n  n 

such  that  y  =   ^  -y  w '  •  This  implies  that  x  =   ^  -y  v '  and  Y,y   —  ^  •  Furthermore,  since 

i=0     '  i=0     '  i=0     ' 

n      _  —    n  —  — 

X  G  X,    X!(Av')7    =  A^^V  =  Ax  <  b.    Therefore,  7  G  T.    Finally,  since  fs  is 

i=0  i=0 

n  Q 

affine  and  satisfies  fs(v')  =  f(v'),  i=0,l,..,n,  we  obtain  fs(x)  =  fs(  X^-yV)  =  Xif  (v") 


^0     •  ,T0     '   SV 


i=0 


11  

ii)   Assume  that  7  is  an  extreme  point  of  F.    Let  x  =    ^7  v  '•   Then,  by  part  i), 


i=0 


X  G  X.   Since  x  G  X,  again  using  part  i),  it  follows  that  no  7  G  F,  7  ?i  7,  exists  such 

n 

that  X  =  y  ^  V '  • 
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Suppose  that  x  is  not  an  extreme  point  of  X.  Then,  since  x  6  X,  for  some  points 

x',  x^  e  X  distinct  from  x  and  for  some  a  6  (0,1),  x  =  ax'  +  (l-a)xl    Since  x', 
x^  e  X,  by  part  i),  for  each  j  =  1,2,  x^  =   ^y|v'  for  some  7',  7^  G  r.    Therefore, 

i=0 

X  =    Ot^yly^i     +    (l-a)f;^fv' 

1=0  i=o 

=   iictyl  +  (l-a)7^)v' 

1=0 

Q 

where,  by  convexity  of  T,  (ay'+(l-a)y')  E  T.    Since  no  7  E  T,  7  ^  7,  exists  such 

n 

that  X  =   lyy',  this  implies  that  7  =  a7'  +  (l-a)72.  Therefore,  7  =  7'  =  y\  since  7 

is  an  extreme  point  of  r.  On  the  other  hand,  since  xJ  9^  x,j  =  l,2,  y  ?f  7,j  =  l,2.  This 

contradiction  implies  that  the  assumption  that  x  is  not  extreme  point  of  X  must  be  false. 

To  show  the  converse  statement  in  ii),  assume  that  x  is  an  extreme  point  of  X. 

Let  7  be  the  unique  element  of  F  which  satisfies  x  =   ^  7  v  '  ■ 

1-0   ' 

Suppose  that  7  is  not  an  extreme  point  of  T.  Then,  since  7  G  T,  for  some  points 
7',  y^  e  T  distinct  from  7  and  for  some  a  6  (0,1),  7  =  a7'  +  (l-a)72.   Then 


i=0 


E(a7'  +(l-a)7^)^v 


=  «E7,'v'  +  (i-«)i:7N 

=  ax'  +  (l-a)x^ 
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n 

where,  for  each  j  =  1,2,  x^  =   J^tJv'-   By  part  i),  x^  G  X,  j  =  l,2.   Also,  since  y  ^  7> 


i=0 


n 

j  =  1,2,  and  7  is  the  unique  element  of  V  satisfying  x  =    ^  -y  v ' ,  x^  ?i  x,  j  =  1 ,2.   On  the 

i=0     ' 

Other  hand,  since  X  is  an  extreme  point  of  X  and  X  =  ax'  +  (l-a)x^,  x  =  x'  =  x^.  This 
contradiction  implies  that  the  assumption  that  7  is  not  an  extreme  point  of  F  is  untenable, 
and  the  proof  of  part  ii)  is  complete. 


iii)   Assume  that  7*  is  an  optimal  solution  for  problem  (P^).   Let  x*  =   J^7i*v', 

i=0 

and  let  x  be  an  arbitrary  element  of  X.   Then,  by  part  i),  x'  G  X  and,  for  some  unique 

n 

7  G  r,  X  =    5^7v'-    Since  7'  is  an  optimal  solution  for  problem  (P.^), 


i=0 


Ef(v')7i*    ^    Zf(v')7,-  ^3.1) 


i=0  1=0 


From   part  i),   fs(x*)  =   f;f(v')7i'  and   fs(x)  =   y;f(v')7-      Therefore,    from   (3.1), 

1=0  '  i=0  ' 

fs(x*)  <  fs(x).  This  implies  that  x*  is  an  optimal  solution  for  problem  (PJ.  Also,  since 

Q 

fs(x')  =   Y.  f(v  ')7i' '  ^^  optimal  values  of  problems  (PJ  and  (P.^)  are  equal. 


Assume  that  x'  is  an  optimal  solution  for  problem  (PJ.  Let  7*  G  F  be  the  unique 
element  of  F  satisfying  X    =   YjI'^'-    Let  7  be  an  arbitrary  element  of  F.    Then,  by 

_  n 

part  i),  X  =   J]  7  V '  belongs  to  X.   Since  x*  is  an  optimal  solution  for  problem  (PJ,  this 

i=0     ' 

implies  that  fs(x')  <  fs(x).    From  part  i),  fs(x')  =   f;f(v')7i*  and  fs(x)  =   i;f(v')7  • 

1=0  i=0  ' 

n  n 

Therefore,    Xf(v')7,*    S    If(v')7-     This  implies  that  7*  is  an  optimal  solution  for 

i=0  '  i=0  ' 

problem  (PJ,  and  the  proof  is  complete.  ■ 
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From  Theorem  3.3.2,  the  optimal  values  of  problems  (PJ  and  (P.^)  are  equal  and 

for    any    optimal    extreme    point    optimal    solution    y'     E  F    for    problem    (P^), 

n 

X*  =   5^  Yi' V  €  X  is  an  extreme  point  optimal  solution  for  problem  (PJ.   Using  these 


=0 


results,  the  algorithm  will  repeatedly  solve  problem  (P^)  instead  of  problem  (PJ  to  find 
lower  bounds  and  extreme  points  of  X  which  achieve  these  lower  bounds. 
3.4.    The  Concave  Minimization  Algorithm 
At  the  beginning  of  the  algorithm,  an  initial  simplex  S°  that  contains  X  is 
constructed.      Throughout  the  algorithm,  at  any  step  k,  a  lower  bound  LBi.  of  f^  must 
be  computed.  To  aid  in  this  computation,  first,  a  partition  Q^  of  S°  is  obtained.    To 
accomplish  this,  the  algorithm  performs  a  radial  subdivision  of  a  subsimplex  S''"'  of  S° 
to  yield  a  partition  T"  of  S"'.  Then  Q^  is  obtained  by  removing  S"'  from  Q^'  and  adding 
the  elements  of  T*,  where  Q^'  is  the  partition  of  S°  that  is  available  from  step  k-1 .  Also, 
for  each  n-simplex  S^  in  Q^  that  belongs  to  T^,  a  lower  bound  w^  for  the  minimum  of  f 
over  S^nX  is  computed.   For  the  remaining  elements  S^  of  Q^,  a  lower  bound  Wj  for  the 
minimum  of  f  over  S'  Pi  X  is  available  from  some  previous  step.  These  lower  bounds  are 
computed  by  solving  problems  of  the  form  (P^).  To  find  the  global  lower  bound  LB^  for 
the  minimum  of  f  over  X,  the  algorithm  computes  the  minimum  wj  of  the  values  Wj, 
j  6  I(Q^)  and  sets  LB^  =  Wj,  where  I(Q^)  denotes  the  finite  index  set  of  the  elements  in 

In  combination  with  the  branch  and  bound  scheme,  the  algorithm  uses  a  neighbor 
generation  process,  primarily  to  ensure  implementability  and  convergence.    However, 


62 
the  incorporation  of  the  neighbor  search  process  also  provides  a  greater  potential  for 

finding  better  incumbent  solutions. 

In  each  iteration  of  the  algorithm,  an  extreme  point  x  of  X  is  found,  which  is  a 
candidate  for  serving  as  a  basis  of  a  radial  subdivision  of  some  subsimplex  that  is  in  Q''. 
The  neighbor  generation  process  is  invoked  for  each  such  point  x  in  order  to  search 
among  all  the  neighboring  extreme  points  of  x  in  X  to  find  the  ones  that  have  not  been 
used  as  vertices  of  any  subsimplex  in  Q''.  A  list  L  is  kept  of  all  such  extreme  points  of 
X  obtained  in  this  manner. 

Each  time  step  k  is  executed,  unless  the  algorithm  terminates,  an  extreme  point 
X  of  X  must  be  found  to  serve  as  a  basis  for  a  radial  subdivision  in  the  next  step.  To  do 
this,  the  algorithm  proceeds  as  follows.  In  finding  LB^,  the  algorithm  determines  the 
lowest  lower  bound  wj  that  is  available  in  step  k.  The  extreme  point  x^  that  is  found  by 
solving  the  problem  (P^)  used  to  help  compute  Wj  is  inspected  to  see  if  it  has  served  as 
a  vertex  of  any  of  the  subsimplices  of  S^'  that  are  in  the  current  partition.  If  it  has  not, 
the  algorithm  chooses  x^  as  the  extreme  point  of  X  to  be  used  as  a  basis  for  radial 
subdivision  of  a  simplex  that  it  belongs  to.  However,  if  x^  is  a  vertex  of  a  simplex  that 
is  in  the  current  partition,  then,  the  algorithm  examines  the  list  L.  If  the  list  L  is  empty, 
then  the  algorithm  terminates  with  the  incumbent  solution  as  an  optimal  solution  for 
problem  (CM)  (see  Section  3.5  for  the  validity  of  this  approach).  If  the  list  L  is 
nonempty,  the  algorithm  searches  among  the  extreme  points  in  the  list  L  in  order  to  find 
one  that  fails  a  fathoming  test.  During  this  search,  points  are  removed  from  L  as  they 
are  examined,  and  the  neighbor  generation  process  is  invoked  for  each  such  point.   If  L 
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becomes  empty  as  these  points  are  examined,  the  algorithm  terminates,  and  the  current 

incumbent  solution  is  an  optimal  solution  for  problem  (CM).  Thus,  in  each  step  k,  the 
algorithm  either  successfully  identifies  an  extreme  point  of  X  as  the  basis  of  a  radial 
subdivision  process,  or  terminates  with  the  list  L  being  empty. 

For  each  point  that  serves  as  a  basis  for  radial  subdivision,  the  neighbor 
generation  process  is  invoked  regardless  of  the  way  it  was  obtained.  The  extreme  points 
that  serve,  or  are  considered  for  serving,  as  a  basis  for  radial  subdivision  are  placed  in 
another  list  VL  for  book-keeping  purposes. 

Throughout  the  algorithm,  many  feasible  solutions  are  found  for  problem  (CM). 
Therefore,  the  upper  bound,  which  is  the  minimum  of  the  objective  function  values  in 
problem  (CM)  of  the  available  feasible  points,  is  updated  as  these  points  are  obtained. 
The  incumbent  solution,  denoted  x^  in  the  algorithm  statement,  is  a  feasible  point  that 
achieves  this  minimum. 
The  Algorithm  Statement 
Step  0. 

Step  Q- 1  •  Choose  an  n-simplex  S"  g  d  such  that  S^'  ^  X,  and  let  Q"  =  {S°}. 
Let  the  vertices  of  S°  be  {  v",  v',...,v°  }.  Set  N  =  0,  and  VL  =  {  v^  v',...,v''}.  For 
each  i  e  {0,l,...,n}  for  which  V  6  X,  set  N  =  N  U  {  v'  },  and  generate  the  set  E,  of 
extreme  points  of  X  adjacent  to  V  in  X  which  do  not  belong  to  VL.  For  each 
i  6  {0,1, ..,n}   for  which   v'  ^    X,   set  E,  =  0.      Set    l  =  [JE  •    If  N  =  0,   set 

i=0 

UB  =  +00  and  go  to  Step  0.2.    If  N  ?^  0,  choose  x^  E  argmin  {  f(x)|  x  G  NUL  } 
and   set  UB  =  f(x'=). 
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Step  0.2.  Find  the  optimal  value  qo  and  an  extreme  point  optimal  solution  7*  6  F 

for  the  linear  program  (P^)  (see  Section  3.3  for  the  definition  of  problem  (P.^)).    Let 
X  *   =  5^  -yj'  V ' ,  set  Wq  =  qo,  and  set  x°  =  x*.    Generate  the  set  E  of  extreme  points  in 

i=0 

X  adjacent  to  x°  which  do  not  belong  to  VL.   If  E  ^  l,  go  to  Step  0.3.   Otherwise,  set 
L  =  LUE,  and  continue. 

Step  0.3.  Set  LBq  =  Wq.  Set  UBq  =  min  {  UB,  {f(x)|  x6{x°}UE}  }.  If 
UB  9^  +00,  choose  x  6  argmin  {  f(x'),  {f(x)|  xe{x°}UE  }}  and  set  x'  =  x. 
Otherwise,  choose  x  G  argmin  {f(x)|  x  6  {x°}UE}  and  set  x'  =  x.  If  LBq  =  UBq, 
conclude  that  x'  is  an  optimal  solution  for  problem  (CM)  and  stop.  Otherwise,  set  k  =  1 
and  go  to  step  k. 

Step  k.  k>  1.  At  the  beginning  of  step  k,  a  partition  Q^"'  of  S"  is  available  from 
the  previous  step.  Also  available  for  each  n-simplex  S^  E  Q^'  are  a  lower  bound  Wj  for 
the  minimum  of  f  over  SOX  and  an  extreme  point  x^  E  X  found  in  the  process  of 
computing  this  lower  bound.  Assume  that  S''"'  E  Q''"'  denotes  an  element  of  Q''"'  which 
contains  the  point  ?'"'  computed  in  the  previous  step. 

Step  k.l.  If?"'  E  L,  remove  ?"' from  L.  Using?"'  E  S""' as  a  basis,  perform 
a  radial  subdivision  of  S""'  to  obtain  a  partition  T"  of  S""'.  Set  VL  =  VL  U  {?"'}. 

Step  k.2.    For  each  n-simplex  S^  E  T'': 

(i)  With  v',  i=0,  l,..,n  set  equal  to  the  vertices  of  S",  find  the  optimal  value 
qj  and  an  extreme  point  optimal  solution  7'  E  F  for  the  linear  program  (P.^); 

n 

(ii)   Set  xJ  =   X!7,'  V'  ^"d 

i=0 

(iii)  Set   Wj  =  max  {q^,  w^.,}. 
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Step  k.3.    Set  UB^  =  min  {UBk.„  {f(xJ)|  S'  G  T"}}.    If  UB^  =  f(xO  for  some 

j  such  that  S'  E  T^  set  x'  =  x^ 

Step  k.4.    Set  Q'  =  {Q''\S'")  U  1*. 

Step  k.5.    Let  wj  =  min  {  wj  j  E  I(Q^)},  and  set  LB^  =  Wj. 

Step  k.6.  If  LBy  =  UBi-,  conclude  that  x'  is  an  optimal  solution  for  problem 
(CM)  and  stop.    Otherwise,  continue. 

Step  k.7.   (i)    If  x^  ^  VL,  set  x''  =  x^  and  go  to  Step  k.8.  Otherwise,  continue. 

(ii)  If  L  —  0,  conclude  that  x'  is  an  optimal  solution  for  problem  (CM)  and 
stop.    Otherwise,  remove  any  point  x  from  L  and  continue. 

(iii)  Find  any  n-simplex  S'  E  (^  which  contains  x.  If  w"  <  UB^,  set  J?  =  x 
and  go  to  Step  k.8.    Otherwise,  continue. 

(iv)  Generate  the  set  E  of  extreme  points  of  X  adjacent  to  x  which  do  not  belong 
to  VL.  SetVL  =  VLU{x}.  IfE  c  l,  go  to  Step  k.7(iii).  Otherwise,  set  L  =  LUE, 
tlnd  X  E  argmin  {f(x'),  {  f(x)|  xGE}},  set  x'  =  x,  set  UB^  =  f(x'),  and  go  to  Step 
k.7(ii). 

Step  k.8.  Generate  the  set  E  of  extreme  points  of  X  adjacent  to  ^  which  do  not 
belong  to  VL.  If  E  ^  L,  set  k  =  k+1  and  go  to  Step  k.  Otherwise,  set  L  =  LUE, 
find  X  E  argmin  {f(x'^),  {f(x)|  x6E}},  set  \'  -  x,  set  UBi,  =  f(x'),  set  k  =  k+1,  and 
go  to  Step  k. 

The  set  N  in  Step  0. 1  stores  each  vertex  v'  of  S"  which  is  also  an  extreme  point 
of  X.  Since  S"  2  X,  it  follows  that  for  any  vertex  v'  of  S,  if  v'  E  X,  then  v'  is  an 
extreme  point  of  X. 
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In  Step  k.7(iii),  if  the  lower  bound  w"  for  the  simplex  S'  containing  the  point  x 

removed  from  L  exceeds  UB^,  then  control  passes  to  Step  k.7(iv).  In  Step  k.7(iv),  the 
usual  neighbor  generation  process  for  x  and  the  associated  incumbent  upnlate  are 
performed,  and  x  is  added  to  the  list  VL.  However,  control  then  passes  to  Step  k.7(ii) 
rather  than  to  Step  k+1.  In  particular,  no  radial  subdivision  of  the  simplex  S*  is 
performed,  and  no  linear  programming  problems  of  the  form  (P^)  that  would  be 
associated  with  this  radial  subdivision  are  solved.  In  this  sense,  the  simplex  S'  is 
fathomed.  Notice  that  the  point  x  is  not  used  as  a  basis  of  a  radial  subdivision  in  the 
next  step.    However,  since  it  was  a  candidate  for  such  a  use,  x  is  added  to  the  list  VL. 

3.5.    Validity  and  Finiteness 

We  will  now  show  that  the  algorithm  finds  an  optimal  extreme  point  solution  for 
problem  (CM)  in  a  finite  number  of  steps.  To  show  this,  the  following  result  is  needed. 
Theorem  3.5.1.  For  any  k>  1,  if  L  =  0  in  Step  k.7(ii)  of  the  algorithm,  then  VL 
contains  every  extreme  point  of  X. 

Proof.  Assume  that  k>l.  To  prove  the  theorem,  we  will  prove  the 
contrapositive.  Therefore,  assume  at  Step  k.7(ii)  that  an  extreme  point  x  6  X  exists 
which  does  not  belong  to  VL.  Then  either  (1)  at  least  one  extreme  point  of  X  adjacent 
to  X  belongs  to  VL  or  (2)  no  extreme  point  of  X  adjacent  to  x  belongs  to  VL. 

Case  1.  At  least  one  extreme  point  x  of  X  adjacent  to  x  belongs  to  VL.  For  any 
extreme  point  y  of  X  added  to  VL  thorough  Step  k.7.(ii)  of  the  algorithm,  from  Steps 
0.1  and  0.2  and  Steps  w.l,  w.7,  and  w.8,  1  <w<k,  the  neighbor  generation  process 
guarantees  that  all  extreme  points  of  X  adjacent  to  y  which  do  not  belong  to  VL  are 
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contained  in  L.   Since  x  is  an  extreme  point  of  X  adjacent  to  x  which  belongs  to  VL,  and 

X  ^  VL,  this  implies  that  x  e  L.    Hence,  in  this  case,  L  ?i  0. 

Case  2.  No  extreme  point  of  X  adjacent  to  x  belongs  to  VL.  Consider  the 
extreme  point  x"  6  VL.  Since  X  is  a  polyhedron,  there  exist  a  finite  number  of  extreme 
points  y',  y^..,  /  of  X  such  that  x  is  adjacent  to  y',  y*"  is  adjacent  to  y*"*'  for  each  h  = 
l,2,..,t-l,  and  y' is  adjacent  to  x°.  Let  Y'=  {y  6  {y'.y',..,/}  |  y^VL}.  Since  y' is 
adjacent  to  x  and  no  extreme  point  of  X  adjacent  to  x  belongs  to  VL,  y'  ^  VL. 
Therefore  Y'  ?^  0  and  we  may  choose  an  integer  h*  such  that 

h'  =  max  {  he  {1,2,. .,t}  I  y"  ^  VL}. 
If  h*  <  t,  then  y"*  is  adjacent  to  y'-'^'  G  VL.  If  h*  =  t,  then  y"*  is  adjacent  to  x" 
G  VL.  In  either  case,  y*"'  is  an  extreme  pomt  of  X  which  does  not  belong  to  VL  but 
which  is  adjacent  to  an  extreme  point  of  X  which  does  belong  to  VL.  Then,  by  the  same 
reasoning  as  used  in  Case  1  for  x,  it  follows  that  y^'  G  L.  Since  this  implies  that 
L  ?^  0 ,  the  proof  is  complete.  ■ 

We  may  now  show  the  following  result. 
Theorem  3.5.2.   Whenever  the  algorithm  terminates,  the  algorithm's  current  incumbent 
solution  x'  is  an  extreme  point  optimal  solution  for  problem  (CM). 

Proof.   Consider  any  step  k,  k>0  of  the  algorithm.  From  Step  0.3  or,  for  k>  1, 
from  Step  k.5, 

LB,  =  min  {wj  j  G  KQ-O}.  (3.2) 

For  each  j  G  I(Q''),  by  Theorem  3.3.2,  q^,  calculated  in  Step  k.2(i)  for  some  k  <  k,  is 
a  lower  bound  for  the  minimum  of  f  over  X  H  S>.    In  addition,  for  any  sets  A  and  B  such 
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that  A  ^  B,  any  lower  bound  for  the  minimum  of  f  over  B  is  a  lower  bound  for  the 

minimum  of  f  over  A.  The  latter  two  statements  imply  that  for  each  j  E  1(0''),  Wj, 
calculated  in  Step  k.2(iii)  for  some  k  <  k,  is  a  lower  bound  for  the  minimum  ^  of  f 
over  X  n  SJ .   Therefore , 

min  (w^l  J  e  1(0'')}  <  min  {f^  j  G  KCT)}.  (3.3) 

By  Theorem  3.3. 1,  {S^  |  j  €  1(0^)}  is  a  partition  of  S°  ^  X.  This  implies  that  the  right- 
hand-side  of  the  inequality  (3.3)  is  identical  to  f^^.  From  (3.2),  this  implies  that 
LB,  <  f_. 

Suppose  that  the  algorithm  terminates  in  Step  k.  Then  either  (1)  LB,  =  UB,  or 
(2)L  =  0. 

Case  1.  LB,  =  UB,.  Since  UB;,  =  f(x'),  where  x'  is  the  current  incumbent 
extreme  point  solution,  it  follows  that  in  this  case,  LB,  =  f(x').  From  the  discussion 
above,  LB,  <  f^^.  Therefore  f(x')  <  f„,„.  Since  x'  G  X,  this  implies  that  f(x'=)  =  f^, 
so  that  x"  is  an  extreme  point  optimal  solution  for  problem  (CM). 

Case  2.  L  =  0.  Then  k>  1,  the  algorithm  terminates  in  Step  k.7(ii),  and,  from 
Theorem  3.5. 1,  VL  contains  every  extreme  point  of  X.  From  Steps  0. 1,  0.3  and  Steps 
k.  1,  k.3,  k.7,  and  k.8,  1  <k<k,  for  any  extreme  point  x  of  X  contained  in  VL  by  Step 
k.7,  UB,  <  f(x).  Since  UB,  =  f(x'),  where  x'  is  the  current  incumbent  extreme  point 
solution,  and  since  VL  contains  every  extreme  point  of  X,  this  implies  that  t^x")  <  f(x) 
for  all  extreme  points  x  of  X.  Since  problem  (CM)  has  an  optimal  solution  which  is  an 
extreme  point  of  X,  it  follows  that  x"  is  an  extreme  point  optimal  solution  for  problem 
(CM)  and  the  proof  is  complete.  ■ 
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The  algorithm  always  eventually  terminates  by  the  following  result. 

Theorem  3.5.3.    The  algorithm  terminates  in  a  finite  number  of  steps. 

ProoL  Suppose,  to  the  contrary,  that  the  algorithm  does  not  terminate  in  a  finite 
number  of  steps.  Then  Step  k.7  is  executed  an  infinite  number  of  times.  Therefore,  in 
an  infinite  number  of  executions  of  Step  k.7,  either  (1)  the  point  x^  in  Step  k.7(i)  does 
not  lie  in  VL,  or  (2)  a  point  x  in  Step  k.7(ii)  is  removed  from  L. 

Case  1.  In  an  infinite  number  of  executions  of  Step  k.7,  x^  in  Step  k.7(i)  does  not 
lie  in  VL.  From  Steps  k.l  and  k.7(i),  whenever  x^  ^  VL  in  some  step,  it  is  added  to 
the  set  VL  in  the  next  step.  But  each  point  x^  is  an  extreme  point  of  X,  and  X  contains 
a  finite  number  of  extreme  points.  The  latter  two  statements  imply  that  it  is  impossible 
for  X'  not  to  belong  to  VL  in  an  infinite  number  of  executions  of  Step  k.7(i).  Therefore, 
this  case  cannot  occur. 

Casel,  In  an  infinite  number  of  executions  of  Step  k.7,  a  point  x  in  Step  k.7(ii) 
is  removed  from  L.  From  Steps  0. 1,  0.2,  k.7  and  k.8,  L  contains  only  extreme  points 
of  X,  and  the  only  points  ever  added  to  L  by  the  algorithm  are  extreme  points  of  X  not 
already  contained  in  L.  Since  X  contains  a  finite  number  of  extreme  points,  this  implies 
that  it  is  impossible  to  execute  the  removal  of  a  point  x  in  Step  k.7(ii)  from  L  an  infinite 
number  of  times.  Therefore,  this  case  cannot  occur. 

It  follows  that  the  assumption  that  the  algorithm  does  not  terminate  in  a  finite 
number  of  steps  is  false,  and  the  proof  is  complete.  ■ 

Taken  together.  Theorems  3.5.2  and  3.5.3  imply  that  the  algorithm  is  guaranteed 
to  find  an  extreme  point  optimal  solution  for  problem  (CM)  in  a  finite  number  of  steps. 


70 

3.6.    Computational  Benefits  and  Preliminary  Computational  Results 

Computational  benefits.  The  branch  and  bound-neighbor  generation  algorithm 
finds  an  exact  extreme  point  optimal  solution  for  problem  (CM)  in  a  finite  number  of 
iterations.    The  other  major  advantages  of  the  algorithm  are  as  follows. 

a)  The  objective  function  f  is  required  to  be  concave  on  an  open  set  D  containing  X. 
No  further  conditions  are  imposed  on  f.  In  particular,  f  need  not  be  separable  or  even 
analytically  defined. 

b)  The  algorithm  requires  no  nonlinear  computations  and  no  determinations  of  convex 
envelopes  or  other  underestimating  functions. 

c)  The  linear  programming  problems  solved  during  the  branch  and  bound  search  do  not 
grow  in  size,  and  they  differ  from  one  another  in  only  one  column  of  data. 

d)  The  fathoming  test  in  Step  k.7(iii)  helps  avoid  unnecessary  computations.  In 
particular,  when  w-  >  UB^,  the  n-simplex  S'  is  not  partitioned  and  no  linear  programs 
of  the  form  (P.^)  that  would  be  associated  with  this  partitioning  process  are  solved. 

Notice  that  the  linear  programming  problems  solved  during  the  execution  of  the 
algorithm  are  all  of  the  form  of  problem  (P^).  Thus  they  all  contain  (m+n+1) 
constraints  and  (n  +  1)  variables.  Furthermore,  for  each  n-simplex  S^  G  T^  in  step  k.2, 
the  vertices  of  S'  are  identical  to  those  of  its  parent  n-simplex  S''',  except  that  in  S*  the 
vertex  P'  replaces  one  of  the  vertices  v'  of  S** '.  As  a  result,  the  linear  program  (P^) 
associated  with  S^  which  is  solved  in  step  k.2  differs  from  the  one  solved  earlier  for  S"' 
only  in  the  coefficient  for  7;  in  the  objective  function  and  in  the  first  m  constraints.  This 
suggests  that  if  the  simplex  method  is  used,  for  instance,  to  solve  the  linear  programs 
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(P^),  the  optimal  basis  associated  with  S""'  can  be  used  as  a  starting  basis  for  the  simplex 

method  solution  of  the  problem  (P^)  associated  with  S'.   In  this  way,  the  linear  programs 

(P^)  can,  in  general,  be  solved  more  efficiently  than  they  would  be  by  using  the 

traditional  Phase  I-Phase  II  approach  of  the  simplex  method  (Murty  1983). 

Computational  results.  We  have  written  a  computer  code  in  C  which  implements 
the  proposed  algorithm.  We  constructed  60  test  problems,  and  used  the  code  to  solve 
these  problems  on  an  IBM  3090  Model  600J  mainframe  computer.  In  this  section,  we 
describe  the  code,  the  sources  of  the  test  problems,  and  the  computational  effort  that  the 
code  required  to  solve  the  problems. 

It  has  been  pointed  out  (Benson  and  Erenguc  1990,  Horst,  Thoai  and  Benson 
1991,  Pardalos  and  Rosen  1987)  that  the  difficulty  of  finding  a  globally  optimal  solution 
to  a  concave  minimization  problem  limits  the  sizes  of  problems  solvable  by  reasonable 
effort.  Furthermore,  the  amount  of  reported  information  about  the  computational 
behavior  of  existing  algorithms  is  limited.  Since  there  are  no  generally  accepted  test 
problems,  we  have  constructed  various  test  problems  partially  based  on  some  data  in  the 
literature.  The  goals  of  the  computational  experiments  reported  here  were  limited  to 
making  some  preliminary  conclusions  about  the  algorithm. 

The  code  uses  the  simplex-based  subroutines  of  the  Optimization  Subroutine 
Library  (IBM  1990)  to  solve  the  linear  programming  problems  of  type  (P.^)  called  for  in 
the  algorithm.  In  each  run,  the  initial  simplex  S°  that  contains  X  was  constructed 
separately  using  the  method  proposed  by  Horst  (1976).  The  linear  programming 
problems  required  by  Horst' s  method  are  also  solved  by  the  simplex  method  procedures 
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given  in  the  subroutines  of  the  Optimization  Subroutine  Library  (IBM  1990).  The  branch 

and  bound  tree  and  the  lists  L  and  VL  were  maintained  and  processed  using  dynamic  data 

structures. 

The  test  problems  were  constructed  as  follows.  Using  data  from  Pegden  and 
Petersen  (1979),  we  constructed  eight  nonempty,  compact  polyhedra  of  five  different 
sizes,  where  size  is  defined  by  the  number  of  rows  (m)  and  the  number  of  columns  (n) 
in  the  matrix  A.  Next,  we  obtained  six  different  types  of  concave  functions  from  the 
literature  to  use  as  objective  functions.  The  forms  and  sources  of  these  functions  are 
given  in  Table  3.1.  In  function  number  4,  K  represents  any  positive  integer.  We  also 
obtained  some  variations  of  these  functions  by  appending  linear  terms,  negative  quadratic 
terms,  or  both.  Last,  five  categories  of  12  test  problems  each  were  constructed  by 
combining  the  eight  compact  polyhedra  with  the  six  different  types  of  objective  functions 
in  various  combinations. 

For  simplicity,  we  solved  only  problems  in  which  each  extreme  point  of  X  that 
was  encountered  was  nondegenerate.  This  shortened  the  code  required  to  execute  the 
neighbor  generation  process.  This  part  of  the  code  uses  simplex-type  pivots,  which  we 
call  pseudo-pivots.  Although  the  degenerate  case  can  also  be  handled  by  pseudo-pivots, 
the  process  in  this  case  can  become  rather  complicated  (Murty  1968,  Murty  1983).  For 
this  reason,  in  these  initial  computational  experiments,  we  decided  to  eliminate  the 
problems  in  which  degenerate  extreme  points  were  encountered. 
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Table  3.1.    Some  objective  function  forms 
function  no.     functional  form 


source 


1 

r-l      J 

2 

-[1  -  h^l? 

3 

-  iU,  in[i-ii:ixj] 

4 

-KEx,--2(Ex^x^J 

5 

-129x'  +  242x,X2- 129x2^^ 

6 

-(i;x/)in(wi;x/) 

)=1               J=l 

Horst,ThoaiandBenson(1991) 

Horst ,  Thoai  and  Benson  ( 1 99 1 ) 
Horst,  Thoai  andBenson(1991) 

Konno  (1976) 
58x, -1242x2  Tuy,ThieuandThai(1985) 

Horst ,  Thoai  and  Benson(  1 99 1 ) 

Each  run  was  terminated  when  either  an  incumbent  solution  with  an  objective 
function  value  within  five  percent  of  the  optimum  was  found,  or  the  list  L  became  empty. 
We  used  the  following  measures  as  evaluation  criteria. 

1)  Number  of  iterations, 

2)  number  of  nodes  created  in  the  branch  and  bound  search  (which  equals  the  number 
of  linear  programming  problems  solved), 

3)  total  number  of  simplex  iterations  performed, 

4)  total  number  of  pseudo-pivots  performed, 

5)  CPU  time  in  seconds. 

Table  3.2  gives  the  averages  of  these  measures  by  category.    In  Table  3.3,  the 
minimum  and  the  maximum  for  each  measure  in  each  category  are  reported.    A  more 
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detailed  description  of  the  individual  test  problems  and  computational  results  is  given  in 

the  Appendix. 

Table  3.2.    Computational  results:  averages 


m 

n 

Iterations 

Nodes 

Simplex 
Iterations 

Pseudo- 
pivots 

CPU  time 

4 

5 

13.08 

44.08 

89.83 

82.5 

1.9399 

8 

6 

6.67 

20.75 

42.92 

100.5 

1.8229 

3 

7 

0.42 

2.00 

10.08 

24.5 

1.5778 

3 

8 

0.50 

2.42 

10.25 

28.7 

1.5747 

5 

10 

10.25 

42.83 

97.58 

330.8 

2.4247 

Table  3.3.    Computational  results:  extremes 


m 

n 

Iterations 

Nodes 

Simplex 
Iterations 

Pseudo- 
pivots 

CPU  time 

min 

max 

min 

max 

min 

max 

min 

max 

min 

max 

4 

5 

0 

22 

73 

6 

148 

5 

120 

1.58 

2.19 

8 

6 

0 

20 

58 

7 

130 

6 

198 

1.57 

2.21 

3 

7 

0 

3 

8 

7 

27 

21 

42 

1.56 

1.63 

3 

8 

0 

T 

^ 

6 

8 

19 

24 

40 

1.48 

1.61 

5 

10 

0 

62 

283 

11 

756 

30 

1230 

1.57 

6.58 

From  Table  3.2,  it  can  be  observed  that  the  computational  effort  required  to  solve 
the  test  problems  does  not  necessarily  monotonically  increase  as  m  or  n  increases.  Also, 
from  Table  3.3,  it  can  be  noted  that  the  variance  in  the  computational  effort  needed  to 
solve  the  problems  within  a  category  can  be  relatively  small  or  large.  These  observations 
indicate  that  structural  factors  other  than  problem  size  have  significant  effects  on  the 
computational    behavior    of   the    algorithm.       This    conclusion    is    consistent    with 
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computational  results  reported  for  some  other  global  optimization  problems  (see,  for 

instance,  Benson  and  Erenguc  1991,  and  Horst,  Thoai  and  Benson  1990).  Although  our 

computational  results  seem  to  be  encouraging,  generalizations  about  the  computational 

behavior  of  the  algorithm  would  require  further  experimentation. 


CHAPTER  4 

OPTIMIZING  OVER  THE  EFFICIENT  SET: 
FOUR  SPECIAL  CASES  AND  A  FACE  SEARCH  HEURISTIC  ALGORITHM 

In  this  chapter,  we  study  four  special  cases  of  problem  (P).  We  present 
procedures  for  detecting  and  solving  these  special  instances  of  the  problem.  We  also 
present  a  heuristic  algorithm  for  solving  the  general  problem.  First,  preliminaries  are 
given.  The  theoretical  background  required  to  analyze  the  special  cases  and  the 
development  of  the  heuristic  algorithm  are  given  in  Section  4.2.  In  Section  4.3,  we 
present  the  special  cases,  and  give  detection  and  solution  procedures  for  each  case.  The 
face  search  heuristic  algorithm  is  given  in  Section  4.4.  A  discussion  follows  in  Section 
4.5. 

4.1.    Preliminaries 

Let  X  =  {x  E  R°|  Ax  <  b},  where  A  is  mxn,  b  G  R".  Assume  that  X  is 
nonempty  and  compact.  Then,  from  Rockafellar  (1970),  Y  is  a  nonempty,  compact 
polyhedron.  To  help  analyze  problem  (P),  we  will  be  interested  in  the  linear  counterpart 
of  problem  (MOCPY)  which  we  will  denote  problem  (MOLPY). 

The  concept  of  the  ideal  solution  for  problem  (MOLPY)  is  important  in  analyzing 
both  problems  (MOLP)  and  (MOLPY).  Let  y'  denote  the  ideal  solution  for  problem 
(MOLPY).  Notice,  from  Definition  1.1.2,  that  y'  need  not  belong  to  Y.  However,  when 
y'  G  Y,  then  Yg  =  {y'}.  Thus,  it  is  clear  that  the  case  of  y'  belonging  to  Y  is  a  special 
case  of  problem  (MOLPY). 
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Another  special  case  for  problem  (MOLPY)  is  given  in  the  following  definition. 

Definition  4. 1.1.    Problem  (MOLPY)  is  said  to  be  completely  efficient  when  Y  =  Yg. 

Similarly,  when  X  =  Xg,  problem  (MOLP)  is  called  completely  efficient.  Notice 
that  problem  (MOLPY)  is  completely  efficient  if  and  only  if  problem  (MOLP)  is 
completely  efficient. 

To  help  analyze  problem  (P),  we  will  also  be  interested  in  the  linear  programming 
relaxation  of  problem  (P).  This  problem,  which  we  will  denote  problem  (LPug),  is  given 
by 

(LPub)  max  <d,x>,  subject  to  x  G  X. 

Let  UB  denote  the  optimal  objective  function  value  of  problem  (LP^b).  Then  UB  is  a 
finite  number  and  gives  an  upper  bound  on  the  optimal  objective  function  value  Vj  of 
problem  (P). 

Since  X  and  Y  are  each  nonempty  and  compact,  from  Rockafellar  (1970),  X„  and 
Y„  are  each  nonempty. 

We  can  now  describe  the  four  sets  of  conditions  which  give  rise  to  the  four 
special  cases  of  problem  (P)  of  concern  in  this  chapter. 

Case  1:  complete  efficiency.  In  this  case,  problem  (MOLPY)  is  completely 
efficient.  From  an  earlier  observation,  this  case  can  be  equivalently  defined  as  the  case 
when  problem  (MOLP)  is  completely  efficient.  Although  the  frequency  of  this  case  is 
unknown,  it  may  be  more  common  than  was  once  thought,  especially  when  X  has  no 
interior  (Benson  1991a). 
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Case  2:   ideal  solution  with  linear  dependence.    In  this  case,  the  ideal  solution  y* 

for  problem  (MOLPY)  belongs  to  Y,  and  the  problem  of  interest  is  the  special  case  (PD) 
of  problem  (P).  It  is  rare  for  the  condition  y'  E  Y  to  hold.  On  the  other  hand,  problem 
(PD)  may  arise  in  certain  common  situations.  For  instance,  minimization  of  a  criterion 
function  <Ci,x>  of  problem  (MOLP)  over  X^  constitutes  a  special  case  of  problem 
(PD). 

Case  3:  bicriterion  case  with  linear  dependence.  In  this  case,  p  =  2  and  the 
problem  of  interest  is  the  special  case  (PD)  of  problem  (P).  When  p  =  2,  problem 
(MOLP)  is  called  a  bicriterion  linear  programming  problem.  Such  problems  are  not 
uncommon  and  have  received  special  attention  in  the  literature  (see,  for  instance, 
Geoffrion  1967,  Wendell  and  Lee  1977,  Aneja  and  Nair  1979,  Benson  1979). 

Case  4:  relaxation  case.  In  this  case  an  optimal  solution  x*  G  X^^  to  the  linear 
programming  relaxation  (LPub)  of  problem  (P)  exists  which  belongs  to  X^. 

In  Section  4.3,  for  each  case,  we  will  describe  a  simple  linear  programming 
procedure  which  detects  the  case  and  solves  problem  (P)  under  the  special  conditions  of 
the  case. 

To  develop  the  heuristic  procedure,  we  will  partially  rely  on  the  geometrical 
background  and  the  mathematical  programming  problems  provided  in  Section  2.4. 
Recall,  from  Section  2.4,  that 

Xe=  u  {x,|x  e  A} 

where,  A  ^  a  is  a  finite  set,  and  for  each  X  6  A,  X^  denotes  the  optimal  solution  set 
of  the  linear  program  (P^  (Yu  and  Zeleny  1975).    Since  the  optimal  solution  set  of  a 
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linear  program  is  a  face  of  its  polyhedral  constraint  set,  this  implies  that  Xg  can  be 

represented  as  a  finite  union  of  the  faces  Xx,  X  G  A,  of  X.   However,  this  representation 

is  generally  not  unique. 

To  aid  in  its  search,  the  heuristic  procedure  will  solve  the  linear  program  (Py.O 

for  various  values  of  y  6  Y-  and  X  6  A.    In  order  to  determine  the  particular  points 

from  Y-  to  be  used  in  the  heuristic  algorithm,  we  will  make  use  both  the  ideal  point  of 

Y  and  the  anti-ideal  point  of  Y,  where  the  latter  is  defined  as  follows. 

Definition  4.1.2.   The  point  y'^'  €  R""  is  called  the  anti-ideal  point  of  Y  when,  for  each 

AI 

j  =  1,2,... ,p,  yj     minimizes  yj  over  Y. 

The  following  two  definitions  pertain  to  redundancy  in  linear  programming,  and 

can  be  found,  for  instance  in  Karwan  et  al.  (1983).  These  definitions  will  be  used  in  the 

proof  of  Lemma  4.2.2,  which  is  required  in  the  analysis  of  the  third  special  case.   First, 

we  need  to  establish  some  notation.    Since,  in  the  third  special  case,  problem  (MOLP) 

is  assumed  to  be  a  bicriterion  linear  programming  problem,  we  will  assume,  only  for 

the  purposes  of  these  definitions,  that  Y  is  given  by 

Y  =  {  yGR^I  My  <  u,  y  >0  },  (4.1) 

where  M  is  a  kx2  matrix  and  u  G  R^.    Also,  let 

Y^  My^R^I    E   m,^y^  <u„    i  =  l,..,k,  i^^r,  y^>  0,  j  =  1,2} , 
(i.e.  delete  the  r"'  constraint  in  the  definition  of  Y),  where  m,j  refers  to  the  entry  of  M 

in  the  i"'  row  and  j""  column,  and  let 

2 

s  (y)  =  u^-  Xm  y.  for  each  r  G  {l,...,k}  and  y  G  Rl 
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2 

Definition  4. 1.3.   The  constraint  Vrnv    <  u   is  redundant  in  (4.1)  if  and  only  if 

^       r)Jj      -       r 

s^  ^  min{sXy)|  yGY^  }   ^0. 

2 

Definition  4. 1.4.    The  constraint   J]  m  y    <  u    is  weakly-redundant  (w-redundant  for 

j=i    "^  ^ 
short)  if  and  only  if  it  is  redundant  and  s^  =  0. 

We  are  now  ready  to  give  the  theoretical  background  for  the  four  special  cases 
of  problem  (P)  that  we  have  described  and  for  the  heuristic  algorithm  that  will  be 
presented  in  Section  4.4. 

4.2.   Theoretical  Background 

Recall,  from  Chapter  3,  that  problem  (P)  has  an  optimal  solution  that  belongs  to 
X„.    This  result  will  be  utilized  in  the  procedures  of  this  chapter.    To  help  develop  the 
remaining  results  of  this  section,  we  will  use  the  following  technical  properties. 
Lemma  4.2. 1.    For  any  y°  G  Y„,  there  exists  a  point  x°  G  X„  such  that  Cx°  =  y°. 

Proof.  Suppose,  to  the  contrary,  that  if  Cx  =  y°  for  some  x  G  X,  then  x  ^  X„. 
Choose  any  x  G  X  such  that  Cx  =  y°.  Then,  by  assumption,  x  $  X„.  Since  X  is 
compact,  this  implies  that  there  exist  points  z',z-,...,z''  G  X^^  and  scalars  Q;,,a2,...,Q!q  > 
0  such  that 

X  =   La^z',         la,  =  1, 
where  q  >  2  (Rockafellar  1970).    Since  Cx  =  y°,  this  implies  that 

y' =  ioc^y,  (4.2) 
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where,  for  each  i  =  1,2 q,  y'  =  Cz'  G  Y.    For  each  i  =  1,2, ...q,  by  assumption, 

since  z'  G  X„,  Cz'  +  y°  must  hold.    Therefore,  y'  =/=  y°,  i  =  l,2,...,q. 

Let  Y\{y°}  =  {y  G  Y|y  i^  y°}.  Then  it  is  easy  to  see  that  since  y°  is  an 
extreme  point  of  Y,  Y\{y°}  is  a  convex  set.  For  each  i  =  l,2,...,q,  since  y'  G  Y  and 
y'  =^  y°,  it  follows  that  y'  G  Y\{y°}.  Therefore,  any  convex  combination  of  the  points 
y',  i  =  1,2,.. .,q  must  lie  in  Y\{y°}.  But  since  Y  is  a  convex  set  and  the  scalars  a,,  i  = 
l,2,...,q  are  positive  and  sum  to  one,  this  contradicts  (4.2),  and  the  proof  is 
complete.  ■ 

The  next  result  concerns  the  special  conditions  described  in  Case  2  in  Section  4. 1. 
Theorem  4.2. 1.  Assume  that  the  ideal  solution  y'  for  problem  (MOLPY)  belongs  to  Y, 
and  that  d  is  linearly  dependent  on  the  rows  of  C.  Then  any  x°  G  X^  is  an  optimal 
solution  for  problem  (PD). 

Proof.  Since  d  is  linearly  dependent  on  the  rows  of  C,  we  may  choose  a  vector 
w  G  R*"  such  that 

(jT  =  w'^C.  (4.3) 

Consider  the  problem  (PY)  given  by 

max  <w,y>,  subject  to  y  G  Y^. 
By  applying  Theorem  3. 1. 1  to  problem  (PY),  it  follows  that  problem  (PY)  has  an  optimal 
solution  which  belongs  to  Y„  n  Yg.    On  the  other  hand,  as  mentioned  earlier,  since  y' 
G  Y,  Ye  =  {y'}.   Therefore,  y'  G  Y„  and  y'  is  an  optimal  solution  for  problem  (PY). 
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Choose  any  x°  G  Xe,  and  let  y°  =  Cx°.   Then,  by  Lemma  2.4.1(b),  y°  G  Y^. 

Recalling  that  Yg  =  (y'}  whenever  y'  G  Y,  this  implies  that  y°  =  y'.   Therefore,  Cx° 

=  y'.   This  implies,  using  (4.3),  that 

<d,x''>  =  w'^Cx" 

=  <w,y'>.  (4.4) 

Since  <w,y'>  is  a  constant  and  x°  G  Xg  was  arbitrarily  chosen,  (4.4)  implies  that  any 

point  x°  G  Xe  is  an  optimal  solution  for  problem  (PD).  ■ 

Remark  4.2.1.    Notice  in  the  proof  of  Theorem  4.2.1  that  the  point  x°  G  Xg  satisfies 

Cx°  =  y'.    It  follows  that  under  the  conditions  of  Theorem  4.2. 1,  any  optimal  solution 

x°  G  Xe  for  problem  (PD)  satisfies  Cx°  =  y'. 

Remark  4.2.2.    The  assumption  in  Theorem  4.2.1  that  d  is  linearly  dependent  on  the 

rows  of  C  cannot  be  omitted,  as  shown  by  the  following  example. 

Example  4.2.1.   Let  X  =  (x  G  R^|0  <  Xj  <  1,  j  =  1,2,3},  let  p  =  2,  and  let  C  and 

d  be  given  by 


C  = 


1   0  0 
0    1   0 


and  d  = 


respectively.  Then  Y  -  {(yi,y2)  G  R^|0  <  y,  <  1,  i  =  1,2},  and  (y^  =  (1,1)  G  Y. 
The  point  (x")'^  =  (1,1,0)  satisfies  x°  G  X^.  However,  since  Xe  =  {x  G  R^|x,  =  1, 
X2  =  1,  0  <  Xj  <  1},  the  unique  optimal  solution  for  problem  (P)  is  (xV  =  (1,1,1)- 
Therefore,  the  application  of  Theorem  4.2.1  to  this  example  is  invalid  and  yields  the 
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erroneous  conclusion  that  (x°)^  =  (1,1,0)  is  an  optimal  solution  for  problem  (P).   This 

is  because  d  is  not  linearly  dependent  on  the  rows  of  C  in  this  example. 

The  next  result  concerns  the  special  conditions  of  Case  3  given  in  Section  4.2. 

Before  proving  this  result,  we  need  the  following  lemma. 

Lemma  4.2.2.    Let  Y  £  R^  be  a  nonempty  polyhedral  set  defined  as  in  (4.1). 

Let  y°  >  0  be  a  degenerate  extreme  point  of  Y,  and  assume  that  exactly  two  distinct 

edges  E,  and  E^  emanate  from  y".  Let  B"  =  {  B?, . . .  ,B°} ,  where  u  >  1 ,  be  the  set  of  bases 

that  correspond  to  y".  Then  there  exists  v'  E  (l,...,i;}  such  that  in  the  simplex  tableau 

that  corresponds  to  the  basis  B„.,  there  exist  two  distinct  nonbasic  variables  Sn,,  Sn^  such 

that  E,  and  E2  are  obtained  by  increasing  s^^  and  Sn^,  respectively,  to  a  positive  level. 

Proof.    Throughout  the  proof,  we  will  use  the  following  notation. 

mj  :  the  i*  row  of  M,  i  =  l,..,k, 

H'  =  {  yGR^I   <mi,y>  =  Uj  },      i  =  l,..,k, 

S-  =  {  yeR^I   <mi,y>  <  U;  },      i  =  l,..,k, 

S''*'  =  {y6R^|  y;  >  0},  i  =  1,2. 

We  will  assume  without  loss  of  generality  that  m^  9^  0,  i  =  l,..,k. 

Also,  note  that  y  =  fl^'- 
1=1 

Let  Y  =  {(y,s)GR''"'^|  My  +  I^s  =  u,  y,s>0  },  where  I^  is  the  kxk  identity 
matrix,  and  s  =  (s,,..,Sk)^  G  R''  is  the  vector  of  slack  variables  in  the  constraints  of  Y. 

Let  y°  be  a  degenerate  extreme  point  of  Y,  and  let  E,  and  By  denote  the  two 
distinct  edges  that  emanate  from  y°.  For  ease  of  notation,  assume  that  E,  £  H'  and 
E2  £  H^  (notice  that  this  can  be  done  by  relabeling  the  constraints  of  Y  if  necessary). 
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Choose  a  basic  feasible  solution  B„.  corresponding  to  y"  with  s,  and  S2  as  nonbasic 

variables.    Let  S3,..,s,  denote  the  basic  variables  that  are  at  zero  level  at  y°.    Then  the 

following  hold: 

(i)        The  structural  variables  y,  and  yj  are  basic  at  a  positive  level  since  y°  >  0.  Thus 

(k-2)  slack  variables  are  basic. 

(ii)       Since  y°  is  a  degenerate  extreme  point,  t>3  holds. 

(iii)      Exactly  two  slack  variables  are  nonbasic,  namely  s,  and  s^,  (t-2)  are  basic  at  a 

zero  level,  and  (k-t)  are  basic  at  a  positive  level. 

The  organization  of  this  proof  is  as  follows.  First,  we  will  state  and  prove  three 
claims.  The  second  claim  will  establish  the  fact  that  the  vectors  m,  and  m2  are  linearly 
independent.  Then  using  this  fact  and  the  third  claim,  we  will  show  that,  for  any 
r  G  {3,..,t},  the  r*  constraint  is  w-redundant  in  the  definition  of  Y.  This  in  turn  will 
be  used  to  complete  the  proof. 

Claim  1.    H'  and  H^  are  distinct  hyperplanes. 

Proof  of  Claim  1 .  Suppose,  to  the  contrary,  that  H'  =  Hi  Since  m,  ?i  0,  it 
follows  that  dim(H')  =  1  and  there  exists  a  point  d'  E  H'  such  that  d'  and  y'*  are  affinely 
independent.  Then  d'  ^  y"  and  any  y  G  H'  is  an  affine  combination  of  y"  and  d'. 
Thus,  for  any  y  E  H',  y  =  Xd'  +  (1-X)y°  for  some  X  6  R.  Equivalently,  for  any 
y  e  H',  y  =  y"  +  X(d'-y")  for  some  X  G  R. 

Lety'  e  E,  be  a  point  such  that  y'  ^  y°.  Since  E,  c  h',  y'  =  y°+Xi(d'-y°)  for 
someX,  G  R,  X,?^0.  Lety^  G  Ej  be  a  point  such  that  yV  y^  Similarly,  since  H'=tf, 
y^  =  y°+X2(d'-y°)  for  some  X^  G  R,  X-^^O.    Now,  let  X  =  min{  |X,|,  [X^l  }.    Then 
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X  is  positive.   Furthermore,  X,  and  X2  are  opposite  in  sign.   To  see  the  latter  statement, 

suppose,     to     the     contrary,     that     X,     and     X2     are     both     positive.         Then 

y^  4  y"+X(d'-y°)  G  E,nE2,  since  both  E,  and  E2  are  convex.    Since  E,nE2  =  {y°}, 

y3=y0     But  since  X>0,  and  d'  ?i  y",  y^?^y°,  which  is  a  contradiction.     A  similar 

argument  follows  when  X,  and  X2  are  both  assumed  to  be  negative. 

Letyi  =  yO  +  (^:L)X(d'-y°)andy2  =  yO  +  (__L)X(d'-y°).  Theny*  €  Ejand 

1^1 1  1^1 

y^  E  E,.    Also,  y'^iy"  and  y-?^y°  since  X,,  X^  are  nonzero,  X  is  positive,  and  d'?iy°. 
Furthermore, 


^y'-^y^  =  ^(y°-(^)X(d'-y°))  -  ^(y°.(^)X(d'-y«)) 


=   yO. 

2'  \ 

^  )X(d' 

-y^ 

=  yO. 

I(0)X(d' 

-yO) 

=  y^ 

where  the  third  equality  follows  because  X,  and  X2  are  opposite  in  sign.  But  this  result 
contradicts  the  fact  that  y°  is  an  extreme  point  of  Y.  So  our  assumption  is  false  and 
Claim  1  holds. 

Claim  2.    The  vectors  m,  and  m2  are  linearly  independent. 

Proof  of  Claim  2.  Assume,  to  the  contrary,  that  m,  and  m2  are  not  linearly 
independent.  Then,  for  some  X,  G  R,  Xj^^O,  m,  =  X,m2  is  true.  Since  y°  G  H'  and 
y°  G  tf,  u,  =  <m,,y''>  =  X,<m2,y°>  =  X,U2.    So, 

H'  =  {y  G  R^l   <m„y>  =  u,  } 
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=  {y  €  R2|  X,<m2,y>  =  X.Uj  } 

=  {y  e  R^l   <m2,y>  =  u,  }  =  H\ 
which  contradicts  Claim  1.   Notice  that  the  third  equality  above  follows  because  X,  ?iO. 
Thus,  Claim  2  holds. 

Claim  3.    dim{Y)  =  2. 

Proof  of  Claim  3.  Let  y'  E  E,,  and  y^  6  E2  be  two  points  in  Y  such  that  y'  /^y°, 
and  yVy".  Then  y'  =  y°  +  X,m|  for  some  m|  G  R^  m|  ?i  0,  where 
<mt,  m,  >  =0,  and  X,  G  R,  X,  ^^0.  Similarly,  y^  =  yO  +  X^  m^  for  some  m^  6  R^ 
m^  9^  0,  where  <m^,  m2>  =0,  and  X2  G  R,  X2?^0.  Since,  by  Claim  2,  mj  and  mj 
are  linearly  independent,  it  follows  that  m|  and  mj  are  also  linearly  independent. 

To  see  this,  suppose,  to  the  contrary,  that  m\  and  m2  are  linearly  dependent. 
Then      m|    =      Xm^      for      some      X   G   R,      X^^O.  So,      we      have 

0  =   <mt,  m,  >    =   <Xm^,  m,  >    =  X<m^,  m,  >  ,      which      implies      that 
<m2,  m,  >  =  0,  sinceX?iO.  We  also  have,  by  definition  of  m  2 ,  that  <m2,m2>=0. 


Hence  (m2) 


1\T 


m, 


m^ 


=0,  where  mj  ?^0.    So,  columns  of  the  square  matrix 


m, 


are 


nij 

linearly  dependent,  which  in  turn  implies  that  m,  and  mj  are  linearly  dependent.    Since 
this  contradicts  Claim  2,  it  follows  that  mj  and  m^  are  linearly  independent. 

Now,  let  d'  =  y'y  =  X.mf,  and  d^  =  y^-y*^  =  Xjmi.  Then  d'  and  d^  are 
linearly  independent.  Hence,  y",  y',  y^  are  affinely  independent.  Thus  dim(Y)  >  2. 
Since  Y  c  r\  dim(Y)  <  2.  Therefore  dim(Y)  =  2,  and  the  proof  of  Claim  3  is 
complete. 
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Since,  by  Claim  2,  m,  and  nij  G  R^  are  linearly  independent,  they  form  a  basis 

for  R^    Hence  for  any  p  6  R^  p  =  X,m,  +  Xjmj  for  some  X,,  X2  6  R. 

Now,  let  r  G  {3,..,t}.   Then  <mr,y''>  =  u^.    Also,  for  some  X,,  X2  G  R, 

m^  =  X,m,  +  X2m2.  (4.5) 

Case  0.    X,  =  0,  Xj  =  0. 

Then,  from  (4.5),  m^  =  0,  which  is  a  contradiction.    So,  Case  0  cannot  hold. 

Case  1.    Exactly  one  of  X,  and  Xj  is  zero. 

Assume  without  loss  of  generality  that  X,  =  0,  and  X2  "^  0.    Then,  by  (4.5), 

m,  =  X2m2,  (4.6) 

and  Ur  -  <m„  y°>  =  X2<m2,y°>   =  X2U2.  (4.7) 

Since,  by  definition,  S'  =  {y  G  R^|   <m„y>  <  u^},  (4.6)  and  (4.7)  imply  that 

S'  =  {y  G  R2|  X2<m2,y>   <  X2U2}.  (4.8) 

Case  la.    X2  >  0. 

From  (4.8),  Xj  >  0  implies  that  S'  =  {y  G  R^|   <m2,y>  <  U2}  =  S^    So, 
Y  =  ns'  =     fl   S'  =  Y  ■  From  Definition  4.1.3,  this  implies  that  constraint  r  is 
redundant  in  (4.1).   Furthermore,  since  Y  =  Y,  and  y°  G  Y,  y*^  G  Y^.    Hence  Sr  =  0. 
Therefore  constraint  r  is  w-redundant. 

Case  lb.    Xj  <  0. 

From  (4.8),  since  Xj  <  0,  it  follows  that  S'  =  {y  G  R^|  <m2,y>  >  U2}.  So 
S'  n  S^=tf .  Thus  Y  ^  H^  which  contradicts  the  fact  that  dim(Y)=2  (see  Claim  3), 
since  dim(H^)  =  l.   Therefore,  Case  lb  cannot  hold. 
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Case  2.   X,  ^.i  Q,\^  ^  0. 

Then,  by  (4.5),   m^  =  X,m,  +  Xjirij,   and  u,  =  <mr,y°> 
=  X, <ni,,y°>  +X2<m2,y°>.   This  implies  that 

u,  =  X,u,  +  X2U2.  (4.9) 

Case  2a.  X,  and  X2  have  opposite  signs.  Assume  without  loss  of  generality  that 
X,  <  0,  and  X2  >  0. 

Let  y'  =  y°  +  eimj,  where  m2  9^  0,  <m2,m2  >  =  0,  and  e,  G  R,  e,  ?iO,  is 
sufficiently  small  to  guarantee  that  y,  G  Y.  Note  that  Cj  exists  since  E2  £  H^,  and 
E2  ^  Y.  Without  loss  of  generality,  assume  that  e,  >  0  (notice  that  when  e,  >0  cannot 
hold  for  a  given  mi,  then  by  choosing  m,'  =  -mj,  this  assumption  can  be  satisfied). 
Since  y'  G  Y,  we  have 

<mi,  y'>   <  Ui,  i  =  l,..,t 

=»  <mj,  y°  +  e,mi>   <  Uj,  i  =  l,..,t 

=>  <mi,  y">  +e,<mi,m2>   <  Uj,     i=l,..,t 

=*  <mi,m^>   <  0,  i  =  l,..,t.  (4.10) 

Notice  that  (4.10)  follows  since  <mj,y'^>  =  Uj  for  i  =  l,..,t,  and  e,  >  0. 
Also,  from  (4.5),  <m„  y'>   =  X,  <m,,y'>  +  X2<m3,y'>.    This  implies  that 

<m„y'>  =Xi<m,,y">  +e,X,<m,,m2>  +X2<m2,y°>  +e,X2<m2,m2> 
=  X,u,  +  X2U2  +  e,X,  <m,,m2>  (4.11) 

From  (4.10),  with  i  =  l,  we  know  that  <m,,m2>   <  0. 
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Case  2ai.    <m,,m2>  =0. 

From  (4.11)  and  (4.9),  it  follows  that  <nv,y'>  =  u,.  So,  y'  e  W.  Also,  by 
choice  of  y\  y'  6  H\  Recall  that  y°  G  tfOH'.  Thus  y\  f  E  H^nW.  Also,  since 
e,  >  Oand  m^  ^  0,  y'  9^  y°.  Since  y',  y°  E  R^  and  y'  ?^  y°,  dim(tf  nHO  >  1.  But 
dim(H2nH0  <  dim(H2)  =  1.  Thus,  dim(H^ OHO  =  1.  SoH^  =  H'.  Hence,  Y,  =  Y, 
so  that  by  Definition  4.1.3,  constraint  r  is  redundant  in  (4.1).  Since,  in  addition, 
y°  E  Y  =  Yr,  constraint  r  is  w-redundant. 

Case  2aii.    <ni,,m2>   <  0. 

From  (4.11)  and  (4.9),  we  have  <mr,y'>  =  u^  +  e,X,  <m,,m2>.  Since, 
e,  >  0,  X,  <  0,  and  <m,,m^>  <  0,  it  follows  that  e,X,<m,,m2>  >  0.  Thus 
<mr,y'>  >  Ur  ,  which  contradicts  the  fact  thaty'  E  Y.  Therefore,  Case  2aii  cannot 
hold. 

Case  2b.    X,  <  0,  X2  <  0. 

Lety  G  Y.  Then  <m,,y>  <  Uj,  and  <m2,y>  <  U2.  Since  X,  <  0,  X2  <  0, 
we  obtain   X,  <m,,y>   >  X,u,,  and  X2<m2,y>   >  X2U2.    This  implies  that 

X,<m,,y>  +  X2<m2,y>   >  XiU,  +  X2U2  =  u^.  (4.12) 

Also,  by  (4.5), 
S^  =  {y  6  R^l   <m„y>   <  u,} 

=  {y  E  R^l  X,<m,,y>+X2<m2,y>  <  uj. 
Therefore,  since  y  E  S',  X,  <  m,,y> +X2<m2,y>   <  u,.     This,  along  with  (4.12), 
implies  that  X,  <m,,y>  +  X2<m2,y>   =  u^.      Hence  y  E  YU.     Since  y  G  Y  was 
arbitrary,  it  follows  that  Y  Q  W,  which  contradicts  Claim  3.   So,  Case  2b  cannot  hold. 
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Case  2c.   X,  >  0,  Xj  >  0. 

Lety  e  S'nS^  Then  <m,,y>  <  u,,  and  <m2,y>  <  u,.  Since  X,  >  0,  and 
X2  >  0,  we  obtain  X,  <m,,y>  <  X,Ui,  and  X2<m2,y>  <  X2U2,  which  implies  that 
X,  <m,,y>  +  X3<m2,y>  ^  X,u,  +  X^Uj.  By  (4.5)  and  (4.9),  we  obtain 
<m„y>  <  u,.  Thusy  €  S'.  Since  y  6  S'nS^  was  arbitrary,  S'nS^  c  S'.  It  follows 
that  Y,  =  Y,  so  constraint  r  is  redundant  in  (4.1)  by  Definition  4.1.3.  Since,  in 
addition,  y  6  Y  =  Y^,  constraint  r  is  w-redundant. 

Since  all  possible  cases  for  X,  and  X^  have  been  examined,  it  follows  that 
constraint  r  is  w-redundant.  Recall  that  the  choice  of  r  was  arbitrary  among  the 
constraints   3,..,t.    Hence  for  any  i,  i  G  {3,..,t},  constraint  i  is  w-redundant. 

Now,  construct  the  tableau  T„.  for  y"  that  corresponds  to  the  basis  B„..  Then  in 
T„.,  yi,  y2,  S3,...,s,  are  the  basic  variables.  Also,  there  are  (k-t)  slack  variables  different 
from  S3,...,s,  that  are  basic,  but  at  a  positive  level,  and  s,  and  S2  are  nonbasic. 

Let  r  G  {3,...,t}.  Suppose  that  s^  is  a  basic  variable  for  the  q*  row  of  the 
tableau.  Consider  this  row  of  the  tableau  as  the  objective  function  for  the  linear 
programming  problem 

min  sXy),  subject  to  y  G  Y,. 
Since  s,  =  0,  T,.  is  an  optimal  tableau  for  this  problem  (see  Definition  4. 1 .3  and  4. 1 .4). 
Thus  the  optimality  condition  holds,  and  a,;  <  0  for  j  =  1,2  in  T„.,  where  a^,  j  =  1,2,  are 
the  coefficients  in  the  q"'  row  of  T„.  that  correspond  to  the  nonbasic  variables  s,  and  s^. 

Since  r  G  {3,..,t}  was  arbitrary,  for  any  s^  that  is  basic  and  equal  to  zero  in  T„., 
say,  for  the  q"'  row,  a^  <  0,  j  =  1 ,2.   We  also  know  that  in  each  of  the  columns  for  the 
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nonbasic  variables  s,  and  s^,  there  exists  at  least  one  positive  coefficient.    Since  this 

positive  coefficient  cannot  be  in  one  of  the  rows  with  zero  right-hand-side  value,  it  must 

be  in  a  row  with  a  positive  right-hand-side  value.  Hence,  pivoting  on  this  element  of  the 

tableau  yields  a  neighboring  extreme  point  of  y°.  Therefore,  the  edges  E,  and  Ej  can  be 

obtained  in  this  way,  and  this  completes  the  proof.  ■ 

Theorem  4.2.2.    Assume  that  p  =  2  and  that  d  is  linearly  dependent  on  the  rows  of  C. 

Then  there  exists  an  optimal  solution  x'  for  problem  (PD)  which  belongs  to  X^,  and 

which  is  also  an  optimal  solution  to  at  least  one  of  the  linear  programs  (LPub),  (LP,),  and 

(LPz),  where,  for  each  i  =  1,2,  problem  (LP,)  is  given  by 

(LPj)  max  <c„  x>,  subject  to  x  6  X. 

Proof   Let  w  G  R^  satisfy  d^  =  w^C.   Since  p  =  2,  Y  is  a  nonempty,  compact 
polyhedron  in  R^    Consider  the  problem  (PY)  given  by 
(PY)  max  <w,y>,    subject  to  y  G  Y^. 

Since  Y  is  compact  and  the  feasible  region  of  problem  (PY)  is  Y^,  based  on  a 
result  of  Shachtman  (1974),  we  may  assume  without  loss  of  generality  that  for  some  k 
>  1, 

Y  =  {y  e  R^lMy  <  u,  y  >  0}, 
where  M  is  a  kx2  matrix  and  u  E  R^    By  Theorem  3. 1. 1,  we  may  choose  an  optimal 
solution  y*  for  problem  (PY)  which  belongs  to  Y„.   To  prove  the  theorem,  we  will  first 
show  that  y*  maximizes  at  least  one  of  y, ,  y^  and  <  w,y  >  over  Y.   There  are  four  cases 
to  consider. 
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Case  1.   yi  =  y2  =  0. 

Then,  since  Y  c  {y  G  R^ly  >  0}  and  y'  6  Yg,  Y  =  {0}.    Therefore,  in  this 
case,  y*  maximizes  both  y,  and  yj  over  Y. 

Case  2.    y[  >  0  and  yj  =  0. 

Suppose  y  e  Y.    Then,  since  Y  ^  {y  G  R^|y  >  0},  yj  >  yz  =  0.    Since  y* 
G  Ye,  this  implies  that  y,  <  y*.    Therefore,  y*  maximizes  y,  over  Y. 

Case  3.    y[  =  0  and  yj  >  0. 

Then  by  a  similar  argument  to  the  one  given  for  Case  2,  y'  maximizes  yj  over 
Y. 

Case  4.    y*  >  0  and  y2  >  0. 

Let  I^  denote  the  kxk  identity  matrix.    From  linear  programming  theory,  since 
y^  is  an  extreme  point  of  Y,  we  may  choose  a  basic  feasible  solution  for  the  system 

My'  +  I,y2  =  u, 

y',y'  >  0, 
which  corresponds  to  y'  =  y*.    After  some  possible  column  rearrangements,  this  basic 
feasible  solution  can  be  represented  by  the  tableau  T  given  by 


-D 

O 

g 

A 

I. 

b 

where  y^  G  R^  is  the  vector  of  nonbasic  variables,  and  y°  G  R^  is  the  vector  of  basic 
variables  in  the  basic  feasible  solution,  and  y'  =  g  +  Dy'^  =  g  (see  Ecker  and  Kouada 
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1976,  for  instance).    Let  D',  D^  G  R^  denote  the  columns  of  D.    Then  either  b  >  0 

(nondegenerate  case)  or  b  >  0  with  b;  =  0  for  some  i  €  {l,2,...,k}  (degenerate  case). 
Case  4a.    Nondegenerate  Case. 

Suppose  that  y*  does  not  maximize  either  y,  or  yj  over  Y.  We  will  use  multiple 
objective  linear  programming  theory  to  show  that  y*  must  maximize  <w,y>  over  Y. 
Since  b  >  0,  there  exist  a,,  a,  >  0  such  that  for  each  q  =  1,2,  z**  =  g  +  a^D"" 
lies  in  the  relative  interior  of  £">,  where  E'  and  E^  are  the  two  distinct  edges  of  Y  which 
contain  y*.  Since  y*  does  not  maximize  y,  or  yj  over  Y,  it  follows  from  linear 
programming  theory  that  (1)  either  D}  >  0  or  D^  >  0  or  both,  and  (2)  D^  >  0  or  D| 
>  0  or  both.  Since  y'  €  Yg,  if  D}  >  0,  then  D^  <  0.  Similarly,  if  D?  >  0,  then  D^ 
<  0.  Assume  without  loss  of  generality  that  D}  >  0.  Then  the  preceding  statements 
imply  that  D^  <  0,  D?  <  0,  and  D^  >  0. 

From  Ecker  and  Kouada  (1976),  since  y'  G  Yg,  there  exist  X,,^  6  R  such  that 
with  X,  =  X,  and  Xj  =  Xj,  the  following  inequalities  are  satisfied: 

X,  Dj  +  X^D^  <  0  (4.13) 

X,  D\  +  X2  D,^  <  0  (4.14) 

X,.  X2  >  1.  (4.15) 

Since  D^  <  0  and  Dj  >  0,  this  implies  by  (4.14)  and  (4.15)  that  Df  <  0. 

Consider  edge  E'.  From  Steuer  (1986),  if  (4.13)  holds  with  equality  with  X,  = 
X,  and  X2  =  X2,  then  E'  c  Yg.  If  (4.13)  does  not  hold  with  equality  with  X,  =  X,  and 
X2  =  X2,  then,  since  D}  >  0  and  D?  <  0,  there  exists  an  e  >  0  such  that  with  X,  =  X, 
+  e  and  X,  =  X2,  (4.13)  -  (4.15)  are  satisfied  with  (4.13)  holding  as  an  equality. 
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Therefore,  in  this  case,  again  E'  Q  Y^  (Steuer  1986).    By  a  similar  argument,  with 

(4.14)  replacing  (4.13)  and  by  increasing  the  value  of  Xj  =  Xj,  if  necessary,  it  can  be 
shown  that  E^  ^  Ye- 

Since  E',  E^  c  Yg,  Theorem  4.6  in  Benson  (1984)  implies  that  y*  maximizes 
<w,y>  over  Y.  Therefore,  in  this  case,  y'  maximizes  at  least  one  of  y,,  y2  and 
<w,y>  over  Y. 

Case  4b.    Degenerate  Case.    There  are  three  cases  to  consider. 

Case  4b(i).  There  exists  no  edge  of  Y  that  emanates  from  y'.  Then  Y  =  {y*}. 
Therefore,  in  this  case,  y'  maximizes  both  y,  and  y,  over  Y. 

Case  4b(ii).  There  exists  only  one  edge  of  Y  that  emanates  from  y*.  Therefore, 
since  Y  is  compact,  and  y'  G  Y„,  Y  is  a  line  segment  with  y*  as  one  of  its  end  points. 
Let  y  denote  the  other  end  point  of  this  line  segment.  Then,  since  y'  G  Y^,  either 
yi  ^  Yi  or  yj  >  y2,  or  both.  Since  y*  and  y  are  the  only  two  extreme  points  of  Y,  this 
implies  that,  in  this  case,  y*  maximizes  at  least  one  of  yj  and  yj  over  Y. 

Case  4b(iii).  There  exist  exactly  two  edges  of  Y  that  emanate  from  y*.  Then, 
by  Lemma  4.2.2,  there  exists  a  basis  B„.  which  corresponds  to  y',  in  which  there  exist 
two  distinct  nonbasic  variables  s^,,  Sn^  such  that  E,  and  Ej  are  obtained  by  increasing  s^, 
and  Sn,  to  a  positive  level,  respectively.  Also,  from  the  proof  of  Lemma  4.2.2,  for  any 
s,  that  is  basic  at  a  zero  level  in  B,.,  constraint  r  is  w-redundant.  Now,  consider  the 
simplex  tableau  T„.  that  represents  B„.,  and  drop  all  the  rows  that  correspond  to  w- 
redundant  constraints.  Then  in  the  remaining  tableau  T'/  that  represents  y*,  all  of  the 
basic  variables  have  positive  values.    Thus  we  may  assume  that  tableau  T/  is  of  the 
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form  of  tableau  T  with  b>0.   By  applying  the  argument  given  in  Case  4a,  we  conclude 

that  y*  maximizes  at  least  one  of  yj,  y2  and  <  w,y>  over  Y. 

It  follows  from  Cases  1-4  that  the  optimal  solution  y*  E  Y„  for  problem  (PY) 
maximizes  at  least  one  of  yi,y2  and  <w,y>  over  Y.  By  Lemma  4.2.1,  we  may  choose 
a  point  X*  E  X„  such  that  Cx*  =  y*.  To  complete  the  proof,  we  will  show  that  x*  is 
an  optimal  solution  for  problem  (PD)  and  for  at  least  one  of  problems  (LPug),  (LP,),  and 
(LP2). 

By  Lemma  2.4.1(a),  since  y'  G  Y^,  x'  €  X,  and  Cx'  =  y*,  x'  G  X^.  Choose 
any  optimal  solution  x°  for  problem  (PD),  and  let  Cx°  =  y°.    Then 

<d,x''>   =  w^Cx" 
=   <w,y''> 
<  <w,y  •  > 
=  w  ^Cx  • 
=  <d,x  *  >, 

where  the  first  and  last  equalities  follow  from  d^  =  w^C,  the  second  equality  follows 
from  Cx°  =  y°,  the  inequality  follows  from  x°  G  Xg,  Lemma  2.4.1(b),  and  the 
optimality  of  y*  in  problem  (PY),  and  the  third  equality  follows  from  Cx*  =  y*. 
Therefore,  since  x'  G  X^  and  x°  is  an  optimal  solution  for  problem  (PD),  x*  must  also 
be  an  optimal  solution  for  problem  (PD).  Finally,  since  y*  maximizes  at  least  one  of  y,, 
y2  and  <w,y>  over  Y  and  d^  =  w^C,  it  easily  follows  that  x'  is  an  optimal  solution  to 
at  least  one  of  the  problems  (LP^b),  (LP,),  and  (LP2).  ■ 

Remark  4.2.3.  Assume  that  p  =  2  and  d  is  linearly  dependent  on  the  rows  of  C.  Then, 
from  Theorem  4.2.2,  at  least  one  extreme  point  optimal  solution  for  problem  (PD)  can 
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be  found  among  the  extreme  point  optimal  solutions  to  the  linear  programs  (LPug),  (LP,), 
and  (LPj).  However,  as  shown  by  the  following  example,  not  every  extreme  point 
optimal  solution  for  problem  (PD)  need  be  an  optimal  solution  to  one  of  the  problems 
(LPub),  (LP,),  and  (LP,). 

Example  4. 2.2.  Let  X  =  {x  6  R^|0  <  x^  <  1,  j  =  1,2,3},  let  p  =  2,  and  let  C  and 
d  be  given  by 


C  = 


1      1 
-1    -1 


and  d  = 


respectively.  Then  d^  =  w^C  holds  for  w^  =  (-1,  -1),  so  that  the  assumptions  of 
Theorem  4.2.2  hold.  By  observation,  Xg  =  (x  G  R^|x,  =  1,  0  <  X2,X3  <  1},  and  any 
point  in  X^  is  an  optimal  solution  for  problem  (PD).  Consider  (x°)^  =  (1,1,0)  and  (x')"^ 
=  (1,0,1).  Then  x°,x'  6  X„  and  x°  and  x'  are  optimal  solutions  for  problem  (PD). 
However,  for  each  k  =  0, 1 ,  x''  is  not  an  optimal  solution  to  any  of  the  linear  programs 
(LPub),  (LP,),  and  (LP^). 

The  following  result,  along  with  Theorem  2.4. 1  and  Theorem  2.4.2,  will  help  us 
develop  the  heuristic  algorithm  of  Section   4.4. 

Theorem  4.2. 3.  Assume  that  X°  E  A  and  x°  6  Xg,  and  let  y°  =  Cx°.  Let  (u""^,  w°^) 
be  any  optimal  solution  to  the  linear  programming  dual  (Dy^^^)  of  problem  (Py».x°).  where 
u°  represents  the  dual  variables  corresponding  to  the  constraints  (2.1).  Then  x°  belongs 
to  the  efficient  face  X^^^o  of  X,  where  X°  =  u°  +  \°. 
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Proof.    To  prove  the  desired  result,  we  need  to  show  that  x°  is  an  optimal 

solution  to  problem  (PJ  with  X  =  X°.    The  dual  linear  program  to  problem  (Py.,x°)  is 

given  by 

(D..o)  min  -<(xVC^,u>    +   <b,w>, 


S.t 


-Cu  +  A^w  =  CW 
u,  w  >0. 


By  Theorem  2.4.1.,  since  x°  G  X^,  x°  is  an  optimal  solution  for  problem  (Py-,x°)-   By 
duality  theory  of  linear  programming  (see,  for  instance,  Murty  1983), 

(X°)^Cx°  =  -  <(x°fC\u°>  +  <b,w°>. 
Rearranging  this  equation,  we  obtain 

(u°  +  X°)^Cx°  =  <b,w°>.  (4.16) 

Now  consider  the  dual  linear  program  to  problem  (PJ  with  X  =  X°.    This  dual 
program  is  given  by 

(X))  min  <b,w>, 

s.t. 

A'^w  =  c^(u°  +  xy, 

w   >0. 


Since  (u^'^.w'O  is  an  optimal  solution  to  problem  (Dyo^.),  w°  is  a  feasible  solution  for 
problem  (D). 
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Let  w  be  any  feasible  solution  for  problem  (D).     Then  it  is  easily  seen  that 

(u°^,w^)  is  a  feasible  solution  for  problem  (Dy  x  )•  Since  (u^,w^)  is  an  optimal  solution 
for  problem  (Dy.  x»),  this  implies  that 

-<(x°)'rc^,  u°>  +  <b,w>  >  -  <(x°)^C'^,u°>  +  <b,w°>, 
or,  equivalently,  <b,w>   >   <b,w°>.    It  follows  that  w°  is  an  optimal  solution  for 
problem  (D). 

Notice  also  that  since  x°  G  X^,  x°  is  a  feasible  solution  for  problem  (PJ  with 
X  =  X°. 

To  summarize,  we  have  shown  that  with  X  =  X°,  x°  is  a  feasible  solution  to  the 
linear  program  (P^),  w°  is  an  optimal  solution  to  the  dual  linear  program  (D)  of  problem 
(PJ,  and,  by  (4.16),  that  the  objective  function  value  of  x°  in  problem  (PJ  equals  the 
objective  function  value  of  w°  in  problem  (D).  From  linear  programming  duality  theory, 
this  implies  that  x°  is  an  optimal  solution  to  problem  (PJ  with  X  =  X°,  and  the  proof 
is  complete.  ■ 

The  following  corollary  of  Theorem  4.2.3  is  immediate. 
Corollary  4.2.1.   Assume  that  X°  G  A  and  x°  G  Xg,  and  let  y°  =  Cx°.   Let  (u°'^,w°'^) 
be  any  optimal  solution  to  the  linear  programming  dual  (Dy^  x»)  of  problem  (Py«  x-).  where 
u°  represents  the  dual  variables  corresponding  to  the  constraints  (2.1).   Let  X°  =  u°  + 
X°,  and  let  Vg  =  (X°)^Cx°.    Then  the  efficient  face  X  ^  of  X  can  be  represented  as 

A 

X      =  {x  G  X|(X°)^Cx  =  Vq}. 

A,° 

Notice  in  Theorem  4.2.3  and  Corollary  4.2.1  that  the  vector  X°  need  not  lie  in 
A.    However,  by  the  choice  of  M,  if  X°  G  A,  then  e'k°  G  A  for  some  6  G  (0,1). 
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Since,  for  any  ^  >  0,  Xj^.  =  Xg-j^o,  this  implies  that  when  ;^°  £  A  in  these  results,  the 

efficient  face  X;^o  of  X  has  an  alternative  representation  Xi°  such  that  K    e  A.    For 

simplicity,  then,  we  may  (and  will)  assume  without  loss  of  generality  in  these  results  that 

X°  e  A. 

4.3.    Detecting  and  Solving  the  Four  Special  Cases 
In  this  section,  based  partly  on  the  results  developed  in  Section  4.2,  simple  linear 
programming  procedures  are  described  for  detecting  and  solving  the  four  special  cases 
of  problem  (P)  given  in  Section  4.1.    We  proceed  on  a  case-by-case  basis. 

Case  1:  complete  efficiency.  Both  Benson  (1991a)  and  Benveniste  (1977)  have 
provided  tests  for  detecting  the  complete  efficiency  of  problem  (MOLP).  Benveniste' s 
test,  however,  requires  that  X  have  a  nonempty  interior,  while  Benson's  does  not. 
Therefore,  to  detect  whether  or  not  problem  (MOLP)  is  completely  efficient,  we 
recommend  using  Benson's  test. 

Assume  without  loss  of  generality  that  X  =  {x  €  R"|  Ax  =  b,  x  >  0},  where 
A  is  an  m  X  n  matrix  and  b  E  R".  Benson's  test  (Theorem  2  in  Benson  1991a)  calls  for 
finding  the  optimal  value  6  to  the  linear  program  (LP^e)  given  by 

(LP^e)  min<b,q>, 

s.t. 

q^A-z^   >0, 
-u^C+r^A-z^  =  e'^C, 
u,z   >0. 

If  ^  =  0,  problem  (MOLP)  is  completely  efficient.    Otherwise,  it  is  not. 
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If  complete  efficiency  holds,  then  any  optimal  solution  to  the  linear  program 

(LPub)  (cf-  Section  4.1)  is  an  optimal  solution  for  problem  (P).    We  therefore  may  use 
the  following  linear  programming  procedures  for  this  case. 

Detection  procedure.  Find  the  optimal  value  6  to  the  linear  program  (LPce).  If 
0  =  0,  problem  (MOLP)  is  completely  efficient  and  Case  1  applies.  U  d  ^  0,  problem 
(MOLP)  is  not  completely  efficient  and  Case  1  does  not  apply. 

Solution  procedure.  If  6  =  0,  find  any  optimal  solution  x'  and  the  optimal  value 
UB  to  the  linear  program  (LPub).  Then  x*  is  an  optimal  solution  for  problem  (P)  and 
Vd  =  UB. 

Case  2:  ideal  solution  with  linear  dependence.  To  detect  whether  or  not  d  is 
linearly  dependent  on  the  rows  of  C,  it  is  necessary  to  decide  whether  or  not  a  vector  w 
E  RP  exists  such  that  d^  =  w^C.  From  duality  theory  of  linear  programming  (see,  for 
instance,  Murty  1983).  this  may  be  accomplished  by  solving  the  linear  program  (LPq) 
given  by 

(LPd)  max  <d,u>  ,  subject  to  Cu  =  0. 

In  particular,  when  the  optimal  value  of  problem  (LPp)  equals  zero,  d  is  linearly 
dependent  on  the  rows  of  C.  Otherwise,  problem  (LPp)  is  feasible  and  unbounded,  and 
d  is  not  linearly  dependent  on  the  rows  of  C. 

To  detect  whether  the  ideal  solution  y'  for  problem  (MOLPY)  belongs  to  Y,  one 
can  solve,  for  instance,  the  linear  program  (LPj)  given  by 
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(LP,)  max<d,x>, 

s.t. 


<c.,x>   =  y,',      i  =  l,2,...,p, 

xex. 


If  problem  (LPJ  is  feasible,  then  any  optimal  solution  x°  satisfies  Cx°  =  y'  E  Y  and 
x°  G  Xe-  If  problem  (LPj)  is  in  feasible,  then  the  ideal  solution  y'  for  problem 
(MOLPY)  does  not  belong  to  Y. 

Based  upon  these  observations  and  Theorem  4.2.1,  we  may  use  the  following 
linear  programming  procedures  for  this  case. 

Detection  procedure. 

(i)  Solve  the  linear  program  (LPq).  If  problem  (LP^)  is  feasible  and  unbounded, 
then  Case  2  does  not  apply.  Otherwise,  problem  (LPq)  will  have  an  optimal  value  of 
zero,  and  we  continue  to  (ii)   to  see  if  Case  2  applies. 

(ii)  Determine  whether  or  not  the  linear  program  (LP,)  is  feasible.  If  problem 
(LPi)  is  feasible,  then  Case  2  applies.    If  it  is  not  feasible,  then  Case  2  does  not  apply. 

Solution  procedure.  When  Case  2  is  detected,  find  any  optimal  solution  x°  to 
the  linear  program  (LP,).  Then  x°  is  an  optimal  solution  for  problem  (PD)  and  Vj  = 
<d,x°>. 

Case  3:  bicriterion  case  with  linear  dependence.  Let  x °  be  an  arbitrary  element 
of  X.  Then  it  is  well  known  (see,  for  instance,  Zeleny  1982)  that  x°  E  Xg  if  and  only 
if,  with  X  =  x°,  the  linear  program  (LPJ  given  by 
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(LPJ  max  <e,s>, 

s.t. 

Cz-s  =  Cx, 

z  ex, 

s   >0, 

has  an  optimal  value  v,  equal  to  zero,  where  e  G  R"*  is  the  vector  of  ones.  Based  upon 
this  result,  part  of  the  procedure  for  Case  2,  and  Theorem  4.2.2,  we  may  use  the 
following  linear  programming  procedures  for  this  case. 

Detection  procedure.  If  p  =ifc  2  then  Case  3  does  not  apply.  If  p  =  2,  find  the 
optimal  value  of  the  linear  program  (LPq).  If  this  value  equals  zero,  then  Case  3  applies. 
Otherwise,  it  does  not. 

Solution  procedure.    When  Case  3  is  detected,  proceed  as  follows. 

(i)  Find  every  extreme  point  optimal  solution  to  each  of  the  linear  programs 
(LPub),  (LP,),  and  (LP,)  (see  Theorem  4.2.2  for  the  definitions  of  problems  (LPJ,  i  = 
1 ,2).  Let  {x^  I  j  =  1 ,2,. . .  ,t}  represent  the  set  of  distinct  extreme  points  found  in  this  way. 

(ii)  For  each  j  =  l,2,...,t,  find  the  optimal  value  v,j  to  the  linear  program  (LP,j). 
Let  (x^lj  G  J}  represent  the  subset  of  points  of  {x^jj  =  l,2,...,t}  for  which  v^^  =  0. 
Then  any  x*  G  {x^lj  G  J}  which  satisfies 

<d,x'>  =  max  {<d,x>  |x  G  {x^lj  G  J}} 
is  an  optimal  solution  for  problem  (PD),  and  v^,  =  <d,x'>  . 

Remark  4.3.1.  The  solution  procedure  for  Case  3  necessitates  finding  aU  extreme  point 
optimal  solutions  to  certain  linear  programming  problems.     This  can  be  efficiently 
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accomplished  by  using,  for  instance,  the  subroutines  of  ADBASE  (Steuer  1983,  Steuer 

1986). 

Case  4:  relaxation  case.  Based  upon  Theorem  3.1.1  and  part  of  the  procedure 
for  Case  3,  we  may  use  the  following  linear  programming  procedure  for  this  case. 

Combined  detection  -  solution  procedure. 

(i)  Find  any  extreme  point  optimal  solution  x'  to  the  linear  programming 
relaxation  (LPub)  of  problem  (P).    Set  j  =  1. 

(ii)  Find  the  optimal  value  v^  to  the  linear  program  (LP^j).  If  v^  =  0,  then  x^ 
is  an  optimal  solution  for  problem  (P)  and  v^  =  UB  =  <  d,x^  >  .   If  v^  ^  0,  go  to  (iii). 

(iii)  Determine  whether  or  not  the  linear  program  (LP^b)  has  an  extreme  point 
optimal  solution  distinct  from  each  of  x',x^...,x^  If  not,  then  Case  4  does  not  apply. 
If  so,  find  such  a  solution  x^"^',  set  j  =  j  +  1,  and  go  to  (ii). 

Remark  4.3.2.     The  ADBASE  (Steuer   1983)  program   can  be  used  to  efficiently 
implement  step  (iii)  of  the  procedure  for  Case  4  (cf.  Remark  4.3. 1). 

4.4.    The  Face  Search  Heuristic  Algorithm 

In  this  section,  we  will  give  a  heuristic  procedure  for  solving  problem  (P).  The 
heuristic  algorithm  does  not  require  any  special  assumptions  and  is  valid  for  the  general 
case.  However,  if  the  problem  falls  into  one  of  the  categories  that  are  discussed  in  the 
previous  section,  then  the  solution  procedure  suggested  for  that  particular  special  case 
can  be  employed.  Henceforth,  we  will  assume  that  the  problem  is  not  structured  in  such 
a  way   that  makes  the  results  of  Section  4.3  applicable. 
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4.4. 1.    General  Description 

The  goal  of  the  heuristic  algorithm  is  to  find  a  "good"  solution  x'  G  XeHX,,  for 
problem  (P).  To  accomplish  this,  the  algorithm  sequentially  identifies  efficient  faces  Xx, 
X  G  A,  of  X.  For  each  such  face  X^  that  is  found,  an  efficient  extreme  point  of  X 
which  maximizes  <d,x>  over  X^  is  generated.  The  point  x"  is  chosen  so  as  to 
maximize  <d,x>  over  all  of  the  efficient  extreme  points  of  X  thereby  found. 

The  algorithm  begins  by  generating  samples  of  points  from  Y-  and  from  A.  Let 
AS  denote  the  sample  of  points  from  A,  and  let  (YS)-  denote  the  sample  of  points  from 
Y-.  The  nature  and  extent  of  the  subsequent  face  search  is  partially  determined  by  the 
numbers  and  types  of  points  belonging  to  these  samples.  The  user  has  a  partial  role  in 
determining  the  sizes  and  compositions  of  these  samples. 

After  the  sample  sets  are  created,  the  face  search  procedure  begins.  In  this 
portion  of  the  algorithm,  for  each  point  y'  G  (YS)^  and  for  each  point  k'  G  AS,  the 
linear  program  (P  .^)  is  solved  for  any  optimal  solution  x'^  Next,  with  y  =  Cx'\  the 
algorithm  finds  any  optimal  solution  {u'J^,w'J'^)  to  the  linear  programming  dual  of  problem 
(P  <j),  where  u'^  represents  the  dual  variables  corresponding  to  the  constraints  (2.1). 
This  yields  an  efficient  face 

X^,j  =  {x  G  XliWCx  =  vj 
containing  k",  where  'k''  =  u''  +  X^ 
and 

v,j  =  iPfCk". 
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A  linear  program  is  then  solved  to  find  an  extreme  point  x'J  of  X  which  maximizes 

<d,x>  over  the  efficient  face  X^^. 

The  face  search  procedure  is  complete  after  each  combination  of  points  y'  6 

(YS)-  and  X^  j  =  0,1 p,  has  been  processed  in  this  way.    The  heuristic  algorithm 

thereby  finds  a  set  of  efficient  extreme  points  x\  each  of  which  maximizes  <d,x>  over 
an  efficient  face  X^^^  of  X.    The  best  of  these  points  is  the  solution  for  problem  (P) 
recommended  by  the  algorithm. 
4.4.2.    The  Face  Search  Heuristic  Algorithm 

For  clarity  of  presentation,  the  methods  for  generatmg  the  sample  sets  (YS)-  and 
AS  will  be  presented  in  Section  4.4.3. 

Step  1. 

U^      Generate  a  finite  sample  of  points  from  Y-.    Let  (YS)-  = 
{y^y^•••1y''}  denote  this  sample  set. 

L2^      Generate  a  finite  sample  ofpoints  form  A.  Let  AS  =  {Xo,X,,..,Xp}  denote 
this  sample  set. 

Step  2. 

2J,      If  a  point  x°   €   Xg  is  available,  set  x*^   =  x°  and  LB   =    <d,x°>. 
Otherwise,  set  LB  =  -  oo . 

H.      Set  i  =  1  and  j  =  0. 

23^      Find  any  optimal  solution  k"  to  the  linear  program  (P,,  J  with  y  =  y'  and 
X  =  XJ  (see  (4.18),  (4.19)). 
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2.4.  With  y  =  C\''  and  X  =  ^',  find  any  optimal  solution  (u'J^,w'^^  to  the  dual 

linear   program    to   problem    (PyJ,    where   u''   denotes    the   optimal   dual    variables 
corresponding  to  the  constraints  (2. 1)  of  the  linear  program  (PyJ. 

2.5.  Let  k'  =  u"  +  X'.  If  X'J  is  a  positive  multiple  of  X'^'  for  some  v  <  i 
and  j'  <  j  such  that  (i'J-)  4=  (i,j),  then  go  to  Step  3.    Otherwise,  continue. 

2.6.  Let  Vjj  =  (X'O^Cx'J,  and  find  any  basic  optimal  solution  x'J  to  the  linear 
program 

(P,j)  max  <d,x>, 

s.t. 

(XyCx  =  v,^,  (4.17) 

X  ex. 

2J^  If  <d,x'J>  <  LB,  go  to  Step  3.  Otherwise,  set  x'^  =  x"  and  LB  = 
<d,x*'> ,  and  go  to  Step  3. 

Step  3. 

3A^  Set  j  =  j  +  1.  If  j  <  p,  go  to  Step  2.3.  If  j  >  p,  set  i  =  i  +  1,  and 
J  =0. 

12,  If  i  <  q,  go  to  Step  2.3.  If  i  >  q,  then  STOP:  x^  G  X^  H  X„  is  the 
recommended  solution  for  problem  (P). 

In  the  algorithm  statement,  x'  denotes  the  incumbent  solution.  As  the  algorithm 
is  executed,  \'  is  used  to  keep  a  record  of  the  best  feasible  solution  for  problem  (P) 
found  thus  far.  The  final  value  of  x""  is  the  solution  recommended  by  the  algorithm  for 
problem  (P). 
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Step  2.5  includes  a  check  as  to  whether  or  not  X''  is  a  positive  multiple  of  a 

previously-generated  vector  X'J'.     The  purpose  of  the  check  is  to  avoid  regenerating 

efficient  faces  X^^  of  X  which  were  generated  in  earlier  iterations  of  the  algorithm. 

4.4.3.    Generating  the  Sample  Sets 

The  algorithm  requires  the  generation  of  samples  of  points  from  A  and  from  Y-. 
Since  the  number,  locations,  and  dimensions  of  the  efficient  faces  found  by  the  algorithm 
depend  partially  on  the  sizes  and  compositions  of  these  sample  sets,  it  is  important  that 
they  be  generated  with  some  care. 

Generating  AS.  By  construction,  AS  always  contains  (p  +  1)  elements.  To 
generate  this  sample,  the  user  chooses  a  number  N  which  satisfies  1  <  N  <  M-p  +  1. 
The  sample  AS  is  then  given  by  {X°,X',...,X''},  where 

^°  =  e,  (4.18) 

and,  for  each  j  =  l,2,...,p,  V  E  R*"  is  defined  by 

[  N  if  1  =  J. 

Notice  that  for  each  fixed  y'  €  (YS)-,  the  heuristic  algorithm  generates  (p+l) 
efficient  faces  X^,^,  j  =  0,l,...,p,  where  \''  =  u"  +  k>  for  each  j.  Therefore,  to  attempt 
to  maximize  the  number  of  distinct  faces  thereby  found,  and  to  attempt  to  generate  faces 
from  a  variety  of  locations  in  Xg,  one  possibility  is  to  choose  a  sample  of  points  from 
A  with  a  varied  composition.  This  can  be  accomplished  by  choosing  an  appropriately- 
large  value  of  N. 

Generating  (YS)^.  Various  methods  can  be  used  to  generate  the  sample  of  points 
(YS)-   from  Y-.  In  contrast  to  AS,  the  user  has  control  over  both  the  size  and 


108 

composition  of  the  sample  (YS)-  of  points  chosen  from  Y-.    As  in  the  case  of  AS, 

however,  (YS)-  should  be  chosen  so  as  to  attempt  to  maximize  the  number  of  distinct 
efficient  faces  found  by  the  algorithm,  and  to  attempt  to  generate  faces  from  a  variety 
of  locations  in  X^.  To  accomplish  this,  (YS)-  must  contain  an  appropriate  number  and 
variety  of  points.  A  number  of  possible  methods  can  be  used  to  construct  (YS)-  in  this 
way.  One  suggested  method  will  now  be  described.  This  method  is  called  the  Line 
Segment  Partitioning  Method. 

The  Line  Segment  Partitioning  Method  begins  by  finding  the  ideal  and  the  anti- 
ideal  point  of  Y.  Recall  from  the  previous  arguments  that  y'  and  y'^'  generally  do  not 
belong  to  Y.  The  Line  Segment  Partitioning  Method  determines  a  point  y"  between  y"^' 
and  y'  such  that  of  all  line  segments  of  the  form  [y^',y]  which  are  subsets  of  [y^'.y']  and 
lie  in  Y-,  the  line  segment  L  -  [y^',y"]  has  maximum  norm.  The  set  (YS)-  is  then 
generated  by  a  partitioning  of  the  line  segment  L.  The  steps  of  the  method  are  as 
follows: 

The  Line  Segment  Partitioning  Method. 

Step  1. 

Find  the  anti-ideal  point  y^'  and  the  ideal  point  y'  of  Y. 

Step  2. 

Find  an  optimal  solution  (x",au)  6  R""^'  to  the  linear  program 

max  a, 
s.t. 
y^'+a(y'-y^')   <  Cx, 
X  G   X, 
a    >   0, 
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and  set  y"  =  y^'  +  a„(y'-y^'). 

Step  3. 

Chcx)se  a  finite  set  {a,,a2,...,aq}  ^  [0,1]  such  that  0  <  ck,  <  aj  <  ...  <  a, 
<  1. 

Step  4. 

Set  (YS)^  =  {y^y^•  -y'}  where,  for  each  i  =  l,2,...,q,  y'  =  y^  +  ai(y"-y^. 
4.4.4.   Justification 

To  verify  that  the  steps  of  the  algorithm  execute  the  desired  efficient  face  search, 
we  will  use  the  theoretical  background  results  given  in  Section  4.2. 

Let  i  e  {l,2,...,q}  andj  6  {0,1,..., p}.  Then,  from  Step  1  of  the  algorithm,  y 
G  Y-  and  1\.'  6  A.  This  implies,  by  Theorem  2.4.2,  that  the  optimal  solution  \"  in  Step 
2.3  to  the  linear  program  (P,  J  with  y  =  y'  and  X  =  ^j  exists  and  satisfies  x"  E  X^. 
Therefore,  from  Theorem  4.2.3,  Steps  2.4  and  2.5  find  a  "weighting"  vector  X'J  G  A 
whose  corresponding  efficient  face  X^^^  contains  \''.  From  Steps  2.5-2.6  and  Corollary 
4.2.1,  unless  Step  2.5  detects  that  X^,j  was  generated  earlier,  the  point  x'^  found  in  Step 
2.6  maximizes  <d,x>  over  the  efficient  face  X^,j.  Furthermore,  since  x"  is  a  basic 
feasible  solution  of  the  linear  program  (P,^),  it  follows  from  polyhedral  set  theory  (see, 
for  instance,  Rockafellar  1970,  Murty  1983)   that  x"  E  X„. 

It  follows  from  the  reasoning  above  that  each  iteration  of  the  heuristic  algorithm 
accomplishes  two  things.  First,  it  finds  an  efficient  face  X^,j  of  X.  Second,  it  finds  an 
extreme  point  x'^  of  X  which  maximizes  <d,x>  over  X.j.,j.  Thus,  the  accumulated 
iterations  of  the  algorithm  correctly  execute  the  desired  efficient  face  search,  and  the 
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final  recommended  solution  is  an  extreme  point  of  X  which  maximizes  <d,x>  over  the 
union  of  the  efficient  faces  found  by  the  search. 
4.4.5.    Some  Implementation  Issues 

To  implement  the  algorithm,  a  method  for  solving  linear  programming  problems 
must  be  used.  In  particular,  the  algorithm  must  repeatedly  find  primal  and  dual  optimal 
solutions  for  the  linear  program  (Py  J  as  y  and  X  vary,  and  it  must  repeatedly  find  primal 
basic  optimal  solutions  for  the  linear  program  {?,)  as  the  equality  constraint  (4.17) 
varies. 

We  suggest  using  the  simplex  method  and,  if  desired,  the  sensitivity  and 
postoptimality  analysis  procedures  of  the  simplex  method  to  solve  these  linear  programs. 
The  simplex  method  is  reliable,  fast,  and  accurate.  Furthermore,  after  the  first  two 
linear  programs  of  the  forms  (Py  J  and  (P,j)  are  solved  by  the  simplex  method,  the  option 
exists  to  solve  the  subsequent  problems  of  these  forms  relatively  quickly  by  using  the 
optimal  solutions  to  these  first  two  problems  and  the  sensitivity  and  postoptimality 
analysis  procedures  of  the  simplex  method. 

4.5.  Discussion 

In  this  chapter,  we  have  concentrated  on  the  problem  of  optimizing  a  linear 
function  over  the  efficient  set.  This  problem  is  important  in  (MCDM)  for  many  reasons. 
Mathematically,  problem  (P)  is  a  difficult  nonconvex  programming  problem.  Therefore, 
identifying  the  special  cases  of  the  problem  that  can  be  solved  easily  is  important.  We 
think  that  the  procedures  presented  in  Section  4.3  can  be  very  useful  as  screening  devices 
when  solving  problem  (P).   The  face  search  heuristic  algorithm  that  is  given  in  Section 
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4.4  can  be  applied  to  more  general  cases  of  problem  (P).  We  believe  that  the  heuristic 
algorithm  has  many  features  that  make  it  a  good  approach  for  solving  problem  (P).  The 
most  important  features  of  the  algorithm  are: 

a)  it  finds  a  feasible  extreme  point  solution  for  problem  (P)  which  is  guaranteed 
to  maximize  <d,x>  over  the  union  of  the  efficient  faces  that  it  identifies; 

b)  it  can  be  efficiently  implemented  using  only  linear  programming  methods; 

c)  it  allows  the  user  to  manipulate  the  nature  and  extent  of  the  face  search; 

d)  the  efficient  faces  it  finds  need  not  be  adjacent  or  form  a  connected  set. 
Feature  d)  is  esp>ecially  important,  because  it  allows  the  search  procedure  to  be 

diversified.  Hence,  during  the  implementation  of  the  algorithm,  there  is  a  significant 
potential  for  finding  efficient  faces  that  lie  in  different  portions  of  X. 

Feature  c)  indicates  a  direction  for  further  research.  One  of  the  ways  that  the 
user  can  manipulate  the  nature  and  extent  of  the  face  search  is  via  the  sample  sets 
generated  at  the  beginning  of  the  algorithm.  Thus,  alternative  sampling  strategies  for 
accomplishing  these  set  generations  may  be  considered.  The  procedures  that  we  give  for 
generating  these  sample  sets  are  simple,  easy  to  implement,  and  effective.  Other 
methods  for  generating  sample  sets  may  be  developed  and  compared  to  the  procedures 
presented  here  in  terms  of  the  quality  of  the  suggested  solutions  and  computational 
requirements. 

During  the  implementation  of  the  face  search  heuristic  algorithm,  for  each 
efficient  point  obtained,  an  efficient  face  that  contains  the  efficient  point  is  identified. 
However,  an  efficient  point  may  belong  to  more  that  one  efficient  face.   To  improve  the 
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performance  of  the  face  search  heuristic  algorithm,  it  may  be  desirable  to  identify  an 

efficient  face  of  maximal  dimension  that  contains  the  efficient  point.  The  problem  of 
identifying  a  maximally  efficient  face  that  an  efficient  point  belongs  to  has  been  the  focus 
of  some  studies  in  the  area  of  vector  maximization.  However,  the  efficient  points  in 
these  studies  are  restricted  to  efficient  extreme  points  (see,  for  instance,  Ecker  and 
Kouada  1976).  Thus,  given  an  efficient  point  that  is  not  necessarily  an  extreme  point, 
the  problem  of  finding  a  maximally  efficient  face  that  contains  it  constitutes  a  topic  for 
further  research. 


CHAPTER  5 
FINDING  A  DISCRETE  REPRESENTATION  OF  THE  EFFICIENT  SET 

In  this  chapter,  we  will  study  and  give  an  algorithm  for  the  problem  of  finding 
a  discrete  representation  of  the  efficient  set  of  problem  (MOCP)  (cf.  Section  2.4).  To 
our  knowledge,  no  procedures  for  finding  the  efficient  set  of  problem  (MOCP)  have  been 
reported,  except  for  some  special  cases  (cf.  Section  2.3.2.1). 

One  of  our  main  motivations  in  studying  problem  (MOCP)  is  the  fact  that  it  can 
be  specialized  to  solve  problem  (MOLP).  Unlike  many  traditional  approaches  for 
problem  (MOLP)  that  utilize  local  searches  of  efficient  extreme  points,  our  approach  is 
a  global  one.  We  present  some  algorithmic  ideas  for  obtaining  a  representative  sample 
of  efficient  points  that  does  not  consist  of  solely  efficient  extreme  points. 

To  help  in  finding  a  discrete  representation  of  the  efficient  set  of  problem 
(MOCP),  we  will  study  problem  (MOCPY).  Problem  (MOCPY)  is  the  transformation 
of  problem  (MOCP)  into  the  objective  function  space.  It  has  been  noted  (Dauer  1987, 
Dauer  1990)  that  since  the  number  of  objective  functions  is  usually  less  than  the  number 
of  variables  in  problem  (MMP),  the  transformed  problem  has  a  simpler  structure  than 
problem  (MMP).  In  particular,  the  dimension  of  the  set  of  efficient  outcomes  is  usually 
much  smaller  than  the  dimension  of  the  set  of  efficient  solutions  in  problem  (MMP). 
Furthermore,  many  efficient  solutions  of  problem  (MMP)  may  have  the  same  outcome, 
i.e.,  they  may  map  into  the  same  point  in  the  objective  function  space.    Since  our  goal 
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is  to  efficiently  find  a  representation  of  the  efficient  set     with  the  least  amount  of 

redundancy  as  possible,  we  will  solve  problem  (MOCP)  in  the  objecUve  function  space. 
In  Section  5.1,  we  give  some  necessary  preliminaries.  Section  5.2  contains  the 
theoretical  background  for  the  establishment  and  validity  of  the  algorithm.  The  algorithm 
for  finding  a  discrete  representation  of  the  efficient  set  for  problem  (MOCP)  is  given  in 
Section  5.3.  Some  examples  are  given  in  Section  5.4.  A  discussion  follows  in  Section 
5.5. 

5.1.    Preliminaries 
In  this  chapter,  we  will  assume  that  (int  X)  ^  0.    We  will  also  assume  that 
rank(C)  =  p.   Since  X  is  compact  and  convex,   Y  is  a  compact,  convex  set  (Rockafellar 
1970). 

We  will  look  for  a  discrete  representation  of  Ye  and  we  will  denote  this 
representation  by  RYe.  Notice  that  a  point  y  G  Y  belongs  to  Yg  if  and  only  if  there 
exists  no  y  6  Y  such  that   y  >  y. 

In  this  chapter,  we  will  present  a  procedure  for  obtaining  RYg.  This  procedure 
essentially  relies  on  the  theoretical  results  that  are  given  in  Sections  2.4  and  5.2. 

5.2.    Theoretical  Background 

As  was  mentioned  earlier,  our  procedure  will  concentrate  on  problem  (MOCPY) 
rather  than  on  problem  (MOCP).  One  of  the  important  propenies  of  problem  (MOCP) 
is  that  Xe  is  a  connected  set  (Warburton  1983).  This  implies,  using  Theorem  3.1  in 
Warburton  (1980),  that  Y^  is  also  connected. 
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The  following  result  will  be  used  in  establishing  the  fact  that  the  feasible  region 

Y  of  problem  (MOCPY)  has  full  dimension. 

Lemma  5.2.1.   Let  T  ^  R°  be  a  convex  set.   Let  M  be  a  qXn  matrix  of  full  row  rank. 

Let  Z  =  MT  =  {zSR"!  z=Mt  for  some  tGT}.    If  (intT)?i0,  then  (intZ)?i0. 

Proof.  Let  t''  G  (int  T).  Then,  by  definition  of  the  interior,  there  exists  an  e  >0 
such  that 

Brit^ST,  (5.1) 

where  B,(t)  denotes  the  closed  ball  with  radius  e,  centered  at  t  (see,  for  instance, 
Rockafellar  1970).    Let 

f  =  t^  +  le.,      i  =  l,..,n, 


where  ej  denotes  the  ith  unit  vector  in  R".   Since,  for  each  i  =  l,..,n,    ||  t'-t°||   =  £   <  e, 

2 


it  follows  that 

t'  e  Bif)  fori=l,..,n.  (5.2) 

In  addition,  since  t'-t"  =    le„    {t'-t",..,t"-t°}  forms  a  set  of  linearly  independent  vectors 

2 

in  R".  Hence  {t",  t',..,t"}  is  a  set  of  affinely  independent  vectors  in  R°.  Also,  from  (5. 1) 
and  (5.2),  t'  e  T   for  i  =0,1,.., n. 

Let  z'  =  Mt',  i=0,l,..,n.   Then  z'  G  Z,  i=0,I,..,n.    Also,  for  i=0,l,..,n, 

z'-z°  =  Mt'-Mt°  =    iMC:  =  Im',  (5.3) 

2  2 


116 

where  m'  denotes  the  ith  column  of  M.     Since  M  has  rank  q,  there  exist  q  linearly 

independent  columns  of  M.  Without  loss  of  generality,  assume  that  m',..,m''are  linearly 
independent.  Then,  from  (5.3),  {z'-z'',...,z''-z°}  constitutes  a  set  of  linearly  independent 
vectors  in  R*",  which  implies  that  (z",z',..,z^}  is  a  set  of  affmely  independent  vectors  in 
R".  Since  for  i=0,l,..,q,  z'  G  Z,  it  follows  that  dim(Z)  >  q.  Also,  since  Z  9  R**, 
dim(Z)  <  q.  Hence,  dim(Z)  =  q.  From  a  result  in  convex  analysis  (see,  for  instance, 
Rockafellar  1970),  it  follows  that  (int  T)  ^  <Z) .  ■ 

Our  procedure  for  generating  RYg  starts  with  constructing  a  p-simplex  that 
contains  Y.    The  following  result  provides  a  way  of  obtaining  this  simplex. 

Theorem  5.2.1.  Let /?  =  max     <e^C,x> ,  and  let /3    =   min     <c.,x>  fori  =  l,..,p. 

Let   v"  =  (^„/32,..,^p),  and   v^  =  (/3„^2,- A.' ^  -  EiS  , /3^..- A)' J  =  1-'P- 

Let  S  =  CONV  {v°,v',..,vP}.   Then   S  is  a  p-simplex  that  contains  Y. 

Proof-  Notice  that,  since  X  is  compact,  the  quantities  /S,  and  jSj,  i  =  l,..p,  exist. 
Also,  since  Y  =  CX,  jS  =  max  <e,y>  and  |8,  =  min    y^,  i=l,..,p.  To  establish  the 

>eY  ytY 

theorem,  we  will  show  i)  that  S,  as  described  above,  is  a  p-simplex,  and  ii)  that  S 
contains  Y. 

i)  To  show  that  S  is  a  p-simplex,  by  definition,  we  need  to  show  that  v",  v',  ..,vp 
are  affinely  independent.  Equivalently,  we  will  show  that  v'-v",  v^-v°,...,vP-v°  are 
linearly  independent.    Notice  that,  for  j  =  l,..,p, 

v^-v"  =  (0,..,0,  /3-i:^.,  0,...,0),  (5.4) 
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where  the  quantity  /j-  ^/J  is  located  in  the  j"^  entry  of  (vJ-v'*). 

1=1   ' 

Claim.     0-  f;/3.  ?^  0. 


p 
1 
Proof  of  Claim.     Notice  from  Lemma  5.2.1  that  (int  Y)  9^  0.     Therefore, 


dim(Y)=p.    Suppose,  contrary  to  the  claim,  that  0-   ^/3    =  0.    Then  it  follows  that 


there  exists  no  y  G  Y  such  that  <e,y>  >   <e,v">.  Since  y  >  v"  for  ally  G  Y,  this 
implies  that,  if  y  G  Y,  theny=v''.  But  this  contradicts  that  dim(Y)=p  >  2.  Therefore, 


<e,y>   >   <e,v*'>  for  some  y  G  Y.    Since,  by  definition, /3  >   <e,y>,iS  >    ^^g.. 

i=i   ' 

p 
Hence  /3-   j^/3    >  0,  and  the  claim  is  established. 
1=1   ' 

By    (5.4)   and    the   above   claim,    it    follows   that   v'-v'^,..,v''-v°  are   linearly 

independent.    Hence,  \°,v\..,\^  are  affinely  independent.   Thus,  S  is  a  p-simplex. 

ii)   Choose  any  y  G  Y.    Then, 

y-v°  >  0.  (5.5) 

Also,/3-  <e,v">  =/3-  f|3    =  max   <e,y>  -  <e,v°>  =  max  <e,(y-v°)>-  Since 

,Ti     '  y6Y  •'  y6Y  ■' 

<e,(y-v°)>   <  max  <e,(y-v'')>   ,  this  implies  that 

y6Y  ■' 

<e,(y-v'»)>  <  /3-  i^.  .  (5.6) 

i=i   ' 

Observe  that,  by  (5.5),  {y-v%  >  0  for  j  =  l,..,p.   So,  by  (5.6),  {y-v%  ^  /^  -  f/?    for 
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p 

each  j  =  l,..,p.      Thus,    for  each  j  =  l,..,p,   (y-v'*)^  =  f^{0  -  ^,0)   for   some   scalar 

i  =  l      ' 

fj  G  [0,1].  Choose  f,,  j  =  l,..,p  in  this  way.    Then  from  (5.4), 

(y-v^  =   i  f(vJ-v°).  (5.7) 

Claim.   0  <    f;  f  <  1. 

p 
Proof  of  Claim.   Notice  that  j;  f  >  0  follows  easily  since  f,  >  0  for  j  =  l,..,p. 

p 
Suppose,  contrary  to  the  claim,  that  j^  f   >  1.    Then,  from  (5.7)  and  (5.4), 

<e,y-v">   =      y   f  <e,vJV>  =       y.  f  (/^  -   f/3)  >  W-   f/3),    where    the    last 

p  p 

mequality  follows  because  y,  f   >  \.  But  this  contradicts  (5.6).  Thus,  ^  f  <  1  must 

j=i    '  j=i    ' 

hold.   This  completes  the  proof  of  the  claim. 

From    (5.7),    y-v°  =   y  t^vJ-v*^  =   Y  fv^  -  ff  flv"-      This   implies   that 

j^i    >  j=i    >  jtl  >^ 

p  p 

y  =   S  fvJ  +  (1-X;f)v"-    Smce  fj  E  [0,1]  for  j  =  l,..,p,  and,  from  the  above  claim, 

p 

y  f   <  1,  It  follows  that  y  is  a  convex  combination  of  the  vertices  of  S.    Therefore 

M  '  ~ 

y  G  S.     Since  y  E  Y  was  arbitrary,  we  conclude  that  Y  ^  s.    This  completes  the 

proof.  ■ 

The  following  theorem  plays  a  key  role  in  developing  the  algorithm  for  obtaining 

RYe  given  in  this  chapter.   Let  S  be  the  p-simplex  constructed  in  Theorem  5.2. 1  which 
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contains  Y.    Let  {v°,v',..,vp}  be  the  vertices  of  S.    Let  S^  =  CONfV{v',..,vP}.    For  a 

given  d  6  S°,  define  the  convex  programming  problem  (P^)  by 

(P )  max<e,v'*+a(d-v'^>, 

s.t.  v''+a(d-v'^  G  Y, 

where  a  G  R  is  the  only  variable. 

Theorem  5.2.2.   Consider  problem  (PJ  as  described  above.   Then  y'   G  Y^  only  if  for 

some  d  G  S°,  y'  =  v*^  +  a*(d-v°),  where  a*  is  an  optimal  solution  to  problem  (PJ. 

Proof.  Let  y'  G  Yg.  To  prove  the  theorem,  we  will  construct  a  point  d  G  S° 
such  that  y*  =  v°  +  a*(d-v°),  where  a'  is  an  optimal  solution  to  problem  (PJ.  Notice 
from  the  proof  of  Theorem  5.2.1,  that  there  exist  scalars  f^  G  [0,1],  i  =  l,..,p,  such  that 


p 

I 
1=1 


y*-v°  =  (/3-   i^^)ir„..,Q,  (5.8) 


Let 


d=yLv',  (5.9) 


where  f  =    Y,f,'  • 
i=i 

Claim,    f  >  0. 

Proof  of  Claim.  Suppose,  contrary  to  the  claim,  that  f  =  0.  Then  f*  =  0, 
i  =  l,..,p.  By  (5.8),  y'-v"  =  0,  hence  y'  =  v°.  Then  Y  =  {v°}.  To  see  this,  suppose 
that  there  exists  y  G  Y  such  that  y  ^  v".  Since  v"  =  (i8,,..,i3p),  by  definition  of  0„ 
i  =  l,..,p,  it  follows  that  y  >  v°.   Thus,  y  >  v"  =  y*,  which  contradicts  that  y'  G  Yg. 
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Hence  Y  =  {v"}   holds.      Since  Y  =  {v"},   it  follows  that  dim(Y)  =  0.      But  this 

contradicts  that  (int  Y)  9^  0.   Thus  the  claim  holds. 

Since  f*  E  [0,1],  i=l,..,p,  and  f>0,  from  (5.9),  d  is  a  convex  combination  of 
the  vertices  of  S°.   Hence  d  €  S°. 

For  any  a  >  0,  using  (5.9),  it  follows  that 

v°  +  aid-w')    =  v"  +  a[  (  f  ii_v  0  -  v°  ] 

-If 

=  v°  +  a[   f  _L  (V  -  v°)  ] 

=  v''+  A  (|S-   f:^)(C..,0,  (5.10) 

f  ,=1    ' 

where  the  last  equality  follows  from  the  definitions  of  v',  i  =  l,..,p. 

Claim,    a'  =  f. 

Proof  of  Claim.    From  (5.8)  and  (5.10),  with  a=f. 


v<'  +  a(d-v«)    =v«  +  (/3-  f/3.)(f:,..,0 


p 

c 

=1 

=  y  • 


Since  y*  G  Yg  ^  Y,    and  f  >  0,  a  =  r  is  a  feasible  solution  for  problem  (PJ.    With 
a  =  f,  by  (5.10),  the  objective  function  value  0,  in  problem  (P<J  is  given  by 


e,  =  <e,v°  +  f(d-v«)>  =  <e,  v°  +  (/3  -  j;^^)(f;,..,Q>  =  <e,v°>  +  fi^  -  j;/?.) 


Suppose  that  «=«  G  R  is  a  feasible  solution  for  problem  (PJ  with  an  objective 
function  value  62  >  6^.   Then,  from  (5.10), 
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$2  =  <ey  +  a(d-v°)> 


p 


f       ,^1  ' 

1  =  1 

Since  6^  >  0^  and  (jS  -  j^^g )  >  0,  it  follows  that  a>f.    Also,  since  a  is  feasible  in 

i  =  l      ' 

problem      (P,),      y  =  v°  +  a(d-v")  G   Y.  From      (5.10),      we      have 

y  =  v°+  -^(^-  i:i8i)(C.-,0-  Since  (f;,..,Q  >  0,  (^S  -  f^.)  >  0,  and   _«_   >1, 
f  1=1  i=i   '  f 

y  =  v"  +     «  (^  -  f;/3.)(f;,..,Q  >  v^  +  K^  -  f;^.)(f:,..,0  =  y*.  Thus,y  >  y*.  But 
f  '='  1=1   ' 

this  contradicts  that  y*  G  Yg.     So  we  conclude  that  no  such  a  exists.     Therefore, 

a'  =  f.    Since  y*  =  v°  +  fCd-v'^  and  d  G  S",  this  completes  the  proof.  ■ 

Remark  5.2. 1.    Theorem  5.2.2  guarantees  that,  if  problem  (PJ  is  solved  for  all  points 

d  G  S°,  the  set  of  efficient  solutions  of  problem  (MOCPY)  is  obtained.  In  our  procedure 

for  obtaining  a  discrete  representation  of  Yg,  we  will  repeatedly  solve  problem  (PJ  for 

various  points  d  G  S".    Combined  with  some  other  ideas,  this  will  help  us  construct 

RYe. 

The  following  result  will  establish  a    different  way  of  formulating  and  solving 
problem  (PJ. 
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Theorem  5.2.3.    Let  d  G  S°.    Consider  the  following  problem  (P^. 

(Pd)  max    a, 

s.t. 

Cx  -  (d-v>  =  v°, 

X  e  X, 

i)   Let  (q!,  x)  be  a  feasible  solution  for  problem  (P^.    Then  a  is  a  feasible  solution  for 
problem  (PJ.    Conversely,  if  a  is  a  feasible  solution  for  problem  (PJ,  then  (a,  x)  is  a 
feasible  solution  for  problem  (P^  for  some  x  6  X  such  that  Cx  =  v°  +  a(d-v'^. 
ii)  Let  (a',  x*)  be  an  optimal  solution  for  problem  (P^.    Then  a'  is  an  optimal  solution 
for  problem  (PJ. 

Proof.   Let  d  e  S°. 

i)  Let  (a,  x)  be  a  feasible  solution  for  problem  (P^.  Let  y  =  Cx.  Then 
y  G  Y.  Furthermore,  since  (a,  x)  is  feasible  in  (P^,  Cx  -  (d-v'^a  =  v*^.  This  implies 
that  y  =  v''  +  (d-v°)a.  Since  y  G  Y  and  a>0,  this  implies  that  a  is  a  feasible  solution 
for  problem  (PJ. 

Let  a  be  a  feasible  solution  for  problem  (PJ.  Let  y  =  v"  +  aCd-v'^.  Since  a 
is  a  feasible  solution  for  problem  (PJ,  y  G  Y.  Let  x  G  X  be  a  point  that  satisfies 
Cx  =  y.  Then  Cx  =  v°  +  a(d-v°),  or  rearranging,  Cx-  (d-v'^a  =  v°.  Since  a  >0,  this 
implies  that  (a,x)  is  a  feasible  solution  for  problem  (P^. 

ii)  Suppose  that  (a*,  x*)  is  an  optimal  solution  for  problem  (P^.  Then,  by  part 
i),  a'  is  a  feasible  solution  for  problem  (PJ. 
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Suppose  that  there  exists  a  feasible  solution  a,  for  problem  (PJ  such  that 

<e,  v°+a,(d-v^>   >   <e,  vHa*(d-v^> .   Then 

a,<e,  (d-v")>   >  a'<e,  (d-v°)>.  (5.11) 


Since  d  G  S°  ,  d  =    |^ x.y ' ,  for  some  X;  >  0,  i  =  1 , . . ,p  such  that   y,\.  =  1 .    Thus, 

d-v°  =  (  rXv')-v°  =  (  X;X.v')-(  X;X  )^°  =   XIXCv'-v*^.  Therefore,  from  the  definitions 

of  V,  i=l,..,p,  d-v"  =  (/3  -   f;/3.)(X„..,Xp).  Thus  <e,dV>  =  (/3  -   ^^.)  ^x.  =  (/3  - 

i=i   '  i=i    '  1=1   ' 

^j3).    Since    (jS  -  |;;3)  >  0,  it  follows  that  <e,d-v°>   >  0.    Thus,  from  (5.11), 


a,  >  a'.  By  part  i),  we  may  choose  an  x'  6  X  such  that  (a,,  x')  is  a  feasible  solution 
for  (P^.  Since  (a',x*)  is  an  optimal  solution  for  problem  (P^,  it  follows  that  aj  <  a*, 
which  is  a  contradiction.    Hence  a'  is  an  optimal  solution  for  problem  (Pj).  ■ 

Remark  5.2.2.  Based  on  Theorem  5.2.3,  for  a  given  d  G  S",  we  may  solve  problem 
(P^  instead  of  problem  (PJ.  If  problem  (PJ  is  infeasible,  then,  by  part  i)  in  Theorem 
5.2.3,  problem  (P^  is  also  infeasible.  If  problem  (PJ  is  feasible,  then  the  optimal 
solution  obtained  by  solving  problem  (P^  gives  an  optimal  solution  for  problem  (PJ. 
Notice  that  problem  (P<j)  uses  the  set  Y  in  its  formulation.  Since  Y  is  the  set  of  all 
possible  outcomes  in  our  problem,  and  not  the  original  feasible  region,  constraints  that 
describe  Y  may  not  be  readily  available.  Problem  (P^  eliminates  the  need  for  finding 
constraints  which  describe  Y. 

Theorem  5.2.4.  Let  y*  G  Yg.  Then,  in  Theorem  5.2.2,  the  vector  d  G  S°  such  that 
y'  =  v°  +  a'(d-v°),  where  a'  is  an  optimal  solution  for  problem  (PJ,  is  unique. 
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Proof.    Let  y*  €  Ye.    From  the  proofs  of  Theorem  5.2.1  and  Theorem  5.2.2, 

there  exist  scalars  t^  E  [0,1],  i  =  l,..,p,   with  f  =   ^f_*     >  0,  such  that 


y*  =  v"  +  (/3-   ll3.)in,..,f;).  (5.12) 

i  =  l 

P     f* 

From  the  proof  of  Theorem  5.2.2,  we  know  that  with  d  =  y;  _I_v ',  problem  (PJ  has 

itlf 

p  f* 
an  optimal  solution  a'  such  that  y*  =  v°  +  a*(d-v'').   Let  d'  =   y  _l_v'- 


Letd  G  S^.  Then,  there  exist  nonnegative  numbers  X„  i  =  l,..,p,  with  ^X.  =  1, 

i  =  l     ' 

such  that  d  =   f]Xv'-    Suppose  that,  with  d  =d,  there  exists  an  optimal  solution  a  to 


problem  (PJ  such  that  y*  =  v"  +  a(d-v°).    Then,  from  the  definitions  of  d  and  of  v', 
i  =  l,..,p,  it  follows  that 


y    =  v"  +  a(^-^f3){\,,..,\).  (5.13) 

1=1    ' 

From  (5.12)  and  (5.13),  since  (/3-  ^,0)^0  (see  proof  of  Theorem  5.2.1),  we  obtain 

i=i   ' 

a(K..,\)  =  (f:,..,0.  (5.14) 

From  (5.13),  since    ^x.  =  U  we  obtain   <e,y*>  =  <e,v°>  +  a(j8-^|8.).     From 


(5.12),  we  obtain  <e,y'>  =  <e,v°>  +  r(/3- j^^g),  where  r>0.  Since  (i8-j;/3.)  ?i  0, 


f* 
the  latter  two  statements  imply  that  a  =  f>0.  Thus,  from  (5.14),  X^  =  J_,i  =  l,..,p. 

f 

It  follows  by  definition  of  d  and  d'  that  d*  =  d,  and  the  proof  is  complete.  ■ 
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Remark  5.2.3.    Given  a  point  y  G  Yg,  an  easy  way  to  obtain  the  point  d  G  S°  that 

yields  y  when  problem  (Pj)  is  solved  can  be  derived  from  the  proofs  of  Theorem  5.2.2 
and5.2.6.  Foranyy  G  Yg,  since  Yg  Q  Y  ^  S=CONV{v°,v',..,vP},thereexistscalars 


p  .         .  .  p         ......  ,0,, 


Xo,X,,...Xp  >  0  such  that  j;x   =  1,  and  y  =   jXjV'-   Notice  that  since  v'',v',..,vp  are 


=0  i=0 


affinely  independent,  the  scalars  Xo,X,,..,Xp  are  unique.    Then  the  unique  d  that  yields 
y  can  be  written  as 

d  =  y: — ^V- 

■='l-Xo 
We  will  sometimes  refer  to  d  as  the  direction  that  generates  y. 

Remark  5.2.4.  When  v"  G  Y,  problem  (PJ  is  feasible  for  any  d  G  S°.  This  follows 
easily  from  the  convexity  of  Y.  However,  when  v''  ^  Y,  problem  (P^)  may  be  infeasible 
for  some  points  d  G  S",  i.e.  for  some  points  d  G  S",  there  may  be  no  a  such  that 
v°  +  Q;(d-v'*)  G  Y.  From  S  2  Y,  as  d  varies  over  S°,  and  as  a  varies  over  [0,1], 
v°  +  a(d-v°)  will  vary  over  S  ^  Y.  Notice  also  that,  for  some  points  d  G  S°,  although 
problem  (P^)  is  feasible,  there  may  be  no  a  such  that  v"  +  a(d-v^  G  Ye.  In  that  case, 
problem  (Pj)  generates  a  point  on  the  boundary  of  Y  that  does  not  belong  to  Yg. 
Remark  5.2.5.  Notice  from  Remark  5.2.4  that,  whenever  d  G  S°  and  problem  (PJ  is 
feasible,    a'  <  1  holds,  where  a'  is  an  optimal  solution  to  problem  (P^). 

Theorems  5.2.1  -  5.2.4  provide  the  main  basis  for  the  procedure  we  suggest  for 
obtaining  a  representative  sample  of  points  from  Yg.  These  results  provide  us  with  the 
tools  required  to  obtain  efficient  points  for  problem  (MOCPY)  starting  with  a  sample  of 
points  that  lie  in  the  "back  simplex"  S".    We  will  repeatedly  solve  problem  (Pj)  for 
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various  points  d  in  S'^.    If  problem  (Pj)  is  feasible  for  a  given  d  in  S^,  we  will  obtain  a 

point  y  that  lies  on  the  boundary  of  Y.    Then,  to  see  if  y  belongs  to  Y^,  and  if  not,  to 

find  a  point  that  lies  in  Yg,  we  will  solve  problem  (PyJ  with  X=e.    The  efficient 

solutions  thus  found  constitute  the  discrete  representation  of  Yg. 

In  light  of  Remark  5.2.4,  it  may  be  worthwhile  to  identify  those  elements  of  S° 
that  would  yield  a  feasible  problem  (PJ.  Towards  this  end,  let  D  =  {  d  G  S°|  Problem 
(Pd)  is  feasible}.  We  will  show  that  D  is  a  convex  set.  But  first,  we  need  to  provide  a 
definition  and  to  establish  a  lemma. 

Definition  5.2.1.   Let  Z  ^  rp.   The  projecting  cone  of  Z,  denoted  P(Z),  is  the  set  of  all 
points  h  of  the  form  h  =  Xz,  where  X>0  and  zEZ. 
Lemma  5.2.2.    Let  Z  ^  rp  be  a  convex  set.    Then  P(Z)  is  a  convex  cone. 

Proof.  To  prove  the  lemma,  we  will  use  a  characterization  of  convex  cones  that 
can  be  found,  for  instance,  in  Rockafellar  (1970). 

i)  Let  h  e  P(Z).  Then  h  =  Xz  for  some  z  G  Z,  and  X  >0.  Ut  /x  >  0.  Then 
Mh  =  /i(Xz)  =  (/xX)z,  where  (^X)  >  0.   Thus  /xh  6  Z. 

ii)  Let  h',  h^  E  P(Z).  Then  h'  =  X,z'  for  some  z'  G  Z  and  X,  >0,  and 
h^  =  XjZ^  for  some  z^  G  Z  and  X.  >  0.  If  X,  =  Xj  =  0,  then  h'+h^  =  X,z'  +  XjZ^  = 
0  G  P(Z).     If  X, >0  or  X2>0,  then  Xj+Xj  >  0.     In  this  case,  since  Z  is  convex, 

z  =         "'        z'  +         '^       z'  G  Z,  and  h'+h^  =  (Xj+X,)!  G  P(Z). 


\ 

z'  + 

\^\ 

From  i)  and  ii),  and  by  Theorem  2.6  in  Rockafellar  (1970),  it  follows  that  P(Z) 
is  a  convex  cone.  ■ 
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Theorem  5.2.5.    D  is  a  convex  set. 

Proof.  Let  Z  =  Y  -  {v'^}.  Since  Y  is  a  convex  set,  so  is  Z,  and  from  Lemma 
5.2.2,  P(Z)  is  a  convex  cone. 

Let  d',  d^  E  D.  By  definition  of  the  set  D,  there  exist  y',  y^  E  Y,  and  a,, 
a.  >  0  such  that  v°  +  ajCd'-v'*)  E  Y,  and  v°  +  a2(d^-v'^  6  Y.  Thus  ai(d'-v°), 
a3(d'-v'*)  G  Z  for  some  «],  a^  >  0. 

Let  d  =  Xd'  +  (1-X)d2  for  some  X  G  [0,1].  Since  d'.  d^  G  D  c  s",  and  S°  is 
a  convex  set,  d  G  S".  To  establish  the  convexity  of  D,  we  need  to  show  that  d  G  D. 
There  are  two  cases  to  consider. 

Case  1.    a,  =  0  or  ^2  =  0. 
Since  a,(d'-v")  G  Z,  and  ajCd^-v")  G  Z,  it  follows  that  0  G  Z.  Then  v"  G  Y,  and  with 
d  =  d,  a=0  is  a  feasible  solution  for  problem  (Pj).    Thus  d  G  D. 

Case  2.  a,  >  0  and  a,  >  0- 

Then,  since  J_   >  0,  and  J_  >  0,  and,  by  Lemma  5.2.2,  P(Z)  is  a  cone,  it 

a^  a-, 

follows  that  _L(a,(d'-v^)  G  P(Z),  and  _L  (a^Cd^-v"))  G  P(Z).    Thus,  (d'-v°)  G  P(Z), 
a,  a^ 

and  (d^-v")  G  P(Z).   Since,  by  Lemma  5.2.2,  P(Z)  is  a  convex  set,  X(d'-v°)  +  (1-X)(d2- 

v°)  =  (Xd'  +  (l-X)d')  -  v"  G  P(Z),  which  implies  that 

d-v°  G  P(Z).  (5.15) 

From  the  definitions  of  Z  and  P(Z),  for  some  y  G  Y,  and  7  >  0, 

d-v°  =  7(y-v^  (5.16) 
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Case  2a.    7  =  0. 

Then  from  (5.16),  it  follows  that  d  =  v",  and  hence  v°  G  S".     Since  S°  is  a 

p-simplex  with  vertices   v',   v',..,v'',  there  exist  nonnegative  scalars  /i,,..,^p  with 


P  P  P  P 

V^.  =  lsuchthatv°=  j^^.v'.  Notice  that,  from  v"  =(  ^^)v°=    |;^v',  it  follows  that 

i=l  i=l  i=l  i=l 

p 

tfi-i'v'-y'^  =  0.     Since  (/i„..,^p)  >  0,  v'-v°,..,  vP-v"  are  linearly  dependent,  which 


contradicts  that  v",  v',  ..,  v^  are  affmely  independent.    Therefore,  case  2a  cannot  hold. 
Case  2b.  7  >  0. 

From  (5.15),  I(d-v°)  =  l(7(y-v°))  =  y-v°,  which  implies  that  y  =  v°  +  l(d- 
7  7  7 

v°).    Since  y  6  Y  and  J.   >  0,  this  implies  that  J.  is  a  feasible  solution  for  problem 

7  7 

(P,^  with  d=d.    Hence  d  6  D. 

Thus,  it  follows  that  d  E  D  must  hold.  Hence  D  is  a  convex  set,  and  the  proof 
is  complete.  ■ 

The  following  result  gives  an  important  property  of  the  set  D. 
Theorem  5.2.6.    Dim(D)=p-l. 

Proof.  Since  (int  X)  ?i  0,  and  the  matrix  C  has  rank  p,  by  Lemma  5.2.1, 
(int  Y)  ?i  0.  Lety  6  (int  Y).  Since  (int  Y)  9  Y  ^  S,  there  exist  scalars  Xo,  X,,..,Xp 
such  that 


y  =  fxv,  (5.17) 
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where  VX   =  l,andXj  ^  0,  i=0,l,..,p.  Notice  that  X,  >  0  holds  for  each  i =0,1,.., p, 

1=0    ' 

because  y  G  (int  Y).    For  each  j  =  l,..,p,  let 

y  =  y+I(v*-y),  (5.18) 

where  0<e<  I  is  sufficiently  small  so  that  y  G  Y  holds  for  all  j  G  {l,..,p}.    Observe 
that  e  exists  since  y  G  (int  Y)  (Rockafellar  1970). 

We  will  first  show  that  y,  y',..,  y*"  are  affinely  independent  vectors.  Recall  from 
the  proof  of  Theorem  5.2.1  that  v",  v',..,v''are  affinely  independent.  Since  X<,>0,  from 
(5.17)  and  a  result  in  linear  algebra  (Hadley  1962),  it  follows  that  y,  v',..,vp  are  affinely 
independent.  Hence,  v'-y,  v^-y,..,v''-y  are  linearly  independent.  Then,  for  any  e>0, 
e(v'-y),  e(v^-y),..,e(vP-y)  are  linearly  independent.  Notice  that,  from  (5.18),  y-y  =  e(v>- 
y)  for  j  =  l,..,p.  Thus  y'-y,  y"-y,-.y''-y  are  linearly  independent.  This  implies  that 
y,y',  y^..,y''  are  affinely  independent. 

Let 

d  =   f  J^v\  (5.19) 


1-X„ 


and  for  j  =  l,...p. 


"       (l-e)X. 


d>  =  y  _!_^v'  *  '         "J-  (5-20) 


Claim  1.   d  G  D. 


Proof  of  Claim  1 .     First,  we  will  show  that  d  G  S".   To  see  this,  observe  that, 


for  each  i=l,..,p,  i_   >  0,  and   ^ L_   =  !_   x;X    =1-    Thus,  from  (5.19), 
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d  6  S°.    Also,  from  (5.19),  dV  =    v     ^'    (y'-wQ).    Thus 

■^'1-L 


(l-Xo)(d-v")      =   f  X,(V-v°) 


1=1  1=1 


1=1 
-  y  -  V  -  v°  +  V 
=  y  -  v^ 
where  the  second-to-last  equality  uses  (5.17).    Then  y  =  v"  -I-  (l-^)(d-v°).    Since  (1- 
Xo)>0  and  y  E  Y,  this  implies  that  with  d=d,  problem  (PJ  has  a  feasible  solution  (1- 
Xq).    Hence  d  G  D. 

Claim  2.    Forj  =  l,..,p,  d'  e  D. 

Proof  of  Claim  2.    Let  K  =  1  -  (l-7)Xo.    Since   0<(1-I)<  1,  and  0<Xo<  1,  it 
is  clear  that  0<(l-e)Xy<l.  Thus  0<K<1.   It  also  then  follows  that  for  each  i  =  l,..,p, 

^^~^^^'    >  0  and  ^   >  0.   Furthermore,    f  Hl!^  +  I   =  llll)(  yi)  +  1  = 
K  K  1=1       K  K  K       1=1    '  K 

lL:!l(l-Xo)  +   _i     =    ^~^^~^^^o   =.  1.    From  (5.20)  and  the  latter  two  statements, 
K  K  K 

d*  e  S°  for  each  j  =  l,..,p. 

From  (5.20),  for  each  j  =^  1 , . . ,p, 

K(¥  =1  (l-7)X,v'  +  7vJ. 
1=1 

This  implies  that  for  each  j  =  1 , . .  ,p, 
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K(d'-v")  =    ^  (l-e)Xy  +  evJ  -Kv" 

i  =  l 

=    j;  (l-OXy  -[(l-7)Xo]v"  +  1\'  -  Kv" 


=  (l-e)y  -  (l-K)v"  +  evJ  -  Kv"^ 

=  (l-7)y  -  v"  +  7vJ 

=  y  -  ey  -  V    +  ev^ 

=  y  +  eCv^-y)  -  v" 

=  y  -v", 
where  the  third  equality  follows  from  (5.17)  and  the  last  equality  follows  from  (5.18). 
Thus,  for  each  j  =  l,..,p,  y'  ^  v"  +  K(dJ-v").    Since,  for  each  j  =  l,..,p,  y'  E  Y  and 
K>0,  this  implies  that  for  each  j  =  l,..,p,  K  is  a  feasible  solution  for  problem  (Pj)  with 
d=dJ.    Hence,  for  j  =  l,..,p,  d^  £  D. 

Notice  that  for  each  j  E  {I,..,p},  we  can  express  d^  as  a  convex  combination  of 

X 
d  and  v^.   To  see  this,  let  X,  =  l_  ,  i=l,..,p.   From  (5.19),  (5.20)  and  the  definition 


of  K,  for  each  j  =  1,. 

.,P, 

Ktf 

=  i:(i-7)x,v'  +  iv> 

=  E [(1-0(1 -XX ]v'  -  fv^ 

=  (l-7)(l-Xo)^x,*v'  +  7vJ 
1=1 

=  (l-7)(l-Xo)a  +  ~ev>. 

(5.21) 
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Notice  that 

K         =  1  -  (l-7)Xo  =  (1-7+7)  -  (l-7)Xo 

=  (l-7)(l-Xo)  +  7.  (5.22) 

Hence  (l-7)(l-Xo)  =  K-7.    Observe  from  0<7<1,  0<^<1,  and  (5.22),  that  K>7. 
Thus  (K-7)>0.   Thus  (5.21)  implies  that  for  each  j  =  l,..,p 

dJ  =  iSlld  ^  -IvJ,  (5.23) 

K  K 

where  0<ii:i,  _1<1,  and  ^  +.1  =  1.    So,  for  each  j  =  l,..,p,  tf  is  a  convex 
K       K  K         K 

combination  of  d  and  v^. 

Recall  that  v',..,vp  are  affmely  independent,  and  d  =   f  X,'v''  where  X*  >  0, 

i=l,..,p.  It  follows  from  a  result  in  linear  algebra  (Hadley  1962)  that  d,  v^,..y  are 
affinely  independent.    Hence,  v^-d,  ....yP-d  are  linearly  independent.    From  (5.23),  for 

each  j  =  l,..,p,  dJ-d  =  _i(v'-d).   Since  v^-d,..,vP-d  are  linearly  independent  and  J.  >0, 

K  K 

d^-d,..,d''-d  are  linearly  independent.  Thus  d,  d\..,d'' are  affmely  independent.  Since, 
by  Claims  1  and  2,  d,  d^..,d''  also  belong  to  D,  it  follows  that  dim(D)>p-l.  But 
D  g  S",  anddim(S'^=p-l.   Thus  dim(D)<p-l.    Therefore  dim(D)=p-l.  ■ 

5.3.    The  Shooting  Algorithm 

In  this  section,  we  present  an  algorithm  for  obtaining  a  discrete  representation  of 

Ye.    The  Shooting  Algorithm  that  we  suggest  is  mainly  based  on  Theorem  5.2.2.    We 

will  assume  that  the  p-simplex  S  containing  Y  is  constructed  as  described  in  Theorem 

5.2.1.    Thus  V(S)  and  V(S^  are  known.    The  algorithm  starts  by  generating  a  discrete 
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sample  of  points  SS°from  S".    For  ease  of  presentation,  we  will  discuss  the  issue  of 

generating  SS^'  after  we  give  the  algorithm.    Then,  for  each  point  d  in  the  set  SS*^, 

problem  (PJ  is  solved.     If  d  yields  a  feasible  problem  (Pj),  then,  upon  solving  this 

problem,  a  solution  y  that  lies  on  the  boundary  of  Y  is  obtained.     Intuitively,  this 

corresponds  to  "shooting"  in  the  direction  d  starting  from  v^  towards  the  boundary  of  Y 

in  an  attempt  to  "hit"  a  point  in  Y^.    However,  not  all  of  the  points  y  that  are  "hit"  as 

a  result  of  this  shooting  process  are  efficient  points.  Therefore,  for  each  y  thus  obtained, 

problem  (Py  J  is  solved  with  X=e.   By  Theorem  2.4. 1,  if  y  is  an  efficient  solution,  then 

y  is  an  optimal  solution  for  problem  (Pyx)  with  X=e.    If  y  does  not  belong  to  Y^,  then, 

by  Theorem  2.4.2,  any  optimal  solution  for  this  problem  is  an  efficient  solution  for 

problem  (MOCPY).    The  collection  of  the  points  found  in  this  way  constitutes  RYg. 

5.3.1.   The  Algorithm  Statement 

Step  1. 

Generate  a  sample  of  points  in  S°.  Denote  this  sample  set  as  SS"  =  {d\  d^..,d''}. 

Step  2. 

Set  i  =  l,  RYe  =  0. 

2.1.  Solve  problem  (Pj)  with  d=d'  for  an  optimal  solution  (x*,a*),  if  possible. 
If  problem  (P^)  is  infeasible,  go  to  Step  2.4.    Otherwise,  continue. 

2.2.  Let  y'  =  v°  +  a'(d'-w'). 

2.3.  Solve  problem  (Py  J  with  y=y'  and  X=e  for  an  optimal  solution  y  and  set 
RYe  =  RYe  U  {y}. 
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2.4.  Seti=i+1.  Ifi<q  gotoStep2.1.  Otherwise,  STOP.   RYg  is  the  discrete 

representation  of  Y^  obtained  by  the  algorithm. 

The  key  steps  of  the  algorithm  are  Steps  2.1  and  2.3.  Notice  for  any  d  that  if 
problem  (PJ  is  feasible,  then,  since  X  is  compact  and  convex,  problem  (PJ  has  an 
optimal  solution.  Thus,  Step  2. 1  is  well-defined.  In  Step  2.3,  for  some  y  E  Y,  problem 
(Pyx)  is  solved  with  X=e.  By  Theorem  2.4.1,  if  y  E  Y^,  then  y  is  an  optimal  for 
problem  (Py  J  with  X=e.  If  y^  Yg,  then  by  Theorem  2.4.2,  any  optimal  solution  to 
problem  (PyJ  with  X=e  belongs  to  Y^.  Thus,  the  algorithm  is  well-defined,  and 
performs  the  shooting  process  as  desired. 
5.3.2.   Generating  SS° 

Since  the  quality  of  RY^  is  partially  dependent  on  the  properties  of  the  points  in 
SS°,  it  is  important  that  the  points  in  this  set  provide  a  good  representation  of  S°.  This 
is,  in  fact,  a  similar  but  much  simpler  version  of  the  original  problem  that  we  want  to 
solve,  namely  finding  a  representation  of  Yg.  We  will  present  two  procedures  for 
generating  SS".   The  first  is  probabilistic  in  nature,  the  second  is  deterministic. 

The  Method  of  Random  Weights.  Since  S"  is  a  p-simplex  with  known  vertices, 
and  any  convex  combination  of  these  vertices  is  a  point  in  S°,  generating  SS"  can  be 
reduced  to  the  problem  of  generating  convex  combination  weights.  To  accomplish  this, 
schemes  may  be  developed  for  predetermining  sets  of  convex  combination  weights  in  a 
dispersed  manner.    We  will  use  a  probabilisfic  approach  to  develop  one  such  scheme. 

Steuer  (1986)  discusses  the  issue  of  representing  a  poly  tope  by  a  discrete  set  of 
f)oints.  Steuer  notes  that  when  the  convex  combination  weights  are  drawn  from  the 
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uniform  distribution,  a  multinormal  type  of  buildup  occurs  around  the  geometric  center 

of  the  polytope.  He  then  suggests  using  a  composite  approach,  where  fifty  percent  of 
the  convex  combination  weights  is  drawn  from  the  uniform  distribution,  and  fifty  percent 
is  drawn  from  the  WeibuU  distribution.  Following  the  guidelines  that  Steuer  presents, 
we  give  the  following  procedure  for  generating  SS**. 

Step  1. 

Let  q  be  the  number  of  points  to  be  generated.    Set  SS"  =  0  and  set  j  =  1. 

Step  2. 

2.1.  Setk=l. 

2.2.  Draw  a  real  number  u^  from  the  uniform  distribution. 

2.3.  If  j<   3.,  let  r^  =  u,.    Otherwise,  let  r,,  =  b(-ln(Uk))"^  where  b=0.1,  and 

2 

c=0.3. 

2.4.  Set  k  =  k+1.    If  k<p,  go  to  Step  2.2.  Otherwise,  continue. 
Step  3. 

Fork=l,..,p,  set  X    =  JJL.    Set  tf  =    f  Xv',  and  set  SS°  =  SS"  U  {d^}. 

p  1=1    ' 

Step  4. 

Setj=j  +  1.    If  j<q,  go  to  step  2.    Otherwise,  STOP. 

It  is  easy  to  see  that  the  above  procedure  achieves  the  purpose  of  generating  SS". 
The  only  step  that  needs  explanation  is  Step  2.3.  It  is  known  that  a  draw  from  the 
Weibull  distribution  with  parameters  b  and  c  can  be  obtained  from  the  expression 
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r,,  =  bC-lnCuJ)""  (Steuer  1986).  The  values  for  b  and  c  given  in  the  procedure  are  values 

suggested  by  Steuer  (1986). 

The  Method  of  Successive  Bisection.  The  idea  of  the  Method  of  Successive 
Bisection  is  to  obtain  a  partition  Q  =  {S',  S^..,  S"*}  of  S'*  that  consists  of  (p-1)- 
simplices.  Then  a  point  is  chosen  from  each  (p-l)-simplex  in  the  partition  to  be  included 
in  SS".   The  method  employs  bisection  successively  to  achieve  such  a  partition  Q  of  S°. 

Bisection  of  a  p-simplex  M  is  a  special  form  of  the  radial  subdivision  process 
where  the  point  w  that  constitutes  the  basis  for  the  process  (cf.  Definition  3.3.3)  is  the 
midpoint  of  a  longest  edge  of  M.  The  Method  of  Successive  Bisection  is  an  iterative 
procedure.  At  iteration  k  of  the  procedure,  a  partition  Q^"'  of  S"  is  available  from  the 
previous  iteration.  The  procedure  then  searches  for  a  (p-l)-simplex  S'  of  maximum 
diameter  among  the  (p-l)-simplices  that  belong  to  Q''"',  where  the  diameter  of  a  p-simplex 
M,  denoted  5(M),  is  defined  as  the  length  of  a  longest  edge  of  M.  A  bisection  of  S'  is 
performed  and  the  updated  partition  Q^  is  obtained  by  removing  S'  from  Q''"'  and 
including  the  two  newly-formed  (p-l)-simplices.  Hence,  at  each  iteration,  the  number 
of  (p-l)-simplices  in  the  current  partition  increases  by  one.  After  performing  q-1 
iterations,  the  current  partition  of  S''  contains  q  (p-l)-simplices.  A  point  is  chosen  from 
each  (p-l)-simplex  in  the  current  partition,  and  SS"  is  given  by  the  collection  of  such 
points.    We  now  give  a  formal  description  of  the  method. 

Step  0. 

Let  q  be  the  number  of  points  to  be  generated.  Set  SS°  =  0.  Assume  that 
S'^  =  CONV{v?,..,Vp"}.    Set  Q"  =  {S"}.    Set  k  =  1  and  go  to  Step  k. 
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Step  k. 

Assume  that  Q'''  is  given  by 
Qk-'  =  {§■>,  I     ie{l,..,k}},    where,    if    k>2,    n^  >  n,,    for    all    i=2,..,k,    and 


S».  =CONV{v;,...,v;'},i  =  l,..,k. 


kj^  Find  5k  =     max  {5(S°')}  =         max        ||v/-v^||.    Let  (v^  v^  denote 

ie{i,..,k}  .en    k) 

j.mt  (1..  .p}.  ji«=m 


a  pair  of  vertices  that  achieve  this  maximum. 


s  s 


k.2.    Ut  s"^^'   =  CONV{vJ,..,  v?.,,  ^!l^,  v;^,,...  v!},  and 


S-^*^  =  CONV{v?,..,  vt„  ^^1^,  v^„..,  v;}. 

2 


k.3.  SetQ"  =  (Q^-'\S')  U  s"'^'   U  s"'*^   Ifk  <  q,  setk  =  k+l  and  go  to  Step 

k.    Otherwise  go  to  Step  k.4. 
k.4.    Setj  =  1. 

k.4.i.  Set  dJ  =   ^  ly" ,  set  SS"  =  SS"  U  {dJ}. 

■=ip  ' 

k.4.ii.  Set  j=j  +  l.    If  j  <  q,  go  to  Step  k.4.i.    Otherwise,  STOP. 
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5.3.3   Analysis  of  the  Method  of  Successive  Bisection 

An  important  property  of  the  Method  of  Successive  Bisection  is  that,  as  the 
number  of  points  to  be  generated  increases,  SS°  begins  to  cover  all  of  S°.  The  following 
results  will  help  establish  this  fact. 

Lemma  5.3. 1.  In  the  Method  of  Successive  Bisection,  for  any  k  such  that  1  <  k  <  q-1, 
8i+i  <  hi. 

Proof.    Let  k  satisfy  1  <  k  <  q- 1 .    Let 

h  =  max  I       max       ||  Vj"  -  v„"' || ,     max    ||v/-v^||]  ,  where  s,  r,  t  are  indices  as 

I  i6{l,..,k},n,?!s  J^r,  ms't,  [ 

'-j,m6{l,  .,p),jii;m  J^^m  J 


defined  in  Step  k.l.    Then 

k  <  k-  (5.24) 

Let  u  =  I(vVv/).    Then,  from  Step  k.2,    s"**'   =  CONV{vf,..,  v^„  u,  v?^„..,  v^}, 

and  s"'*^  =  CONV{vf,..,  v^,,  u,  vj^,,..,  v;}.    From  Step  k.3  and  (k+l).l, 

5k^,  =  max  {£k,     max    ||v/-u||}-  (5.25) 

je{i,..p) 

For  any  j  6  {l,..,p}, 

l|v--u||  =  II v;  -  ::I!l II    =    II  <;!::,  !l;!l II    <    lligi II  +  II ^ II 
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<   _  II  vj-vj  II   +  2  II  v'-v'  II ,  where  the  latter  inequality  follows  from  the  definitions  of 

2  2 


v' and  Vj  in  Step  ic.  1.   Thus,  for  any  j  G  {l,..,p}, 

l|v;-u||   <    ||v?-v?|i.  (5.26) 

Since  ||vj-vt||   =  5^,  it  follows  from  (5.24)-(5.26)  that  6^+1  <  di.  ■ 

Proposition  5.3. 1.  Consider  the  sequence  {5|(}"=,  obtained  as  a  result  of  the  Method  of 
Successive  Bisection  as  q  ^  w.  Then  there  exists  a  subsequence  {5^}7=i  of  {^}'k=i 
such  that  as  r  ->  oo ,  {5^ }  -*  o. 

Proof.    As  q  -^  oo.  Step  k  of  the  Method  of  Successive  Bisection  is  executed 

infinitely  many  times.  Then  there  exists  a  nested  sequence  of  simplices  { S  '''}>  where  for 
any  r  >  0,  s'''  is  the  simplex  bisected  at  Step  k^.2.     By  Proposition  4.2  in  Horst  and 

Tuy  (1990),  as  r  ^  00,  5(s'')  -*  0.     Since,  for  any  r  >  0,  5(s'=')  =  \,  as  r  ^  oo, 

k  ^0.  ■ 

Theorem  5.3.1.    As  q  ^  oo ,  k  -*  oo  and  5^  ^  0. 

Proof.  As  q  ^  oo ,  step  k  of  the  Method  of  Successive  Bisection  is  implemented 
infinitely  many  times.  Thus  k^  oo.  From  Lemma  5.3.1,  {4}  is  a  monotonically 
decreasing  sequence  of  real  numbers.  Observe  also  that  {5^}  is  bounded  below  by  zero. 
Thus,  by  a  result  in  real  analysis  (Rudin  1964),  as  q  ^  oo,  {dy.}  -*  6  for  some  5  E  R. 
From  Proposition  5.3.1,  {\}  has  a  subsequence  (5^ }  such  that,  as  r-»  oo,  5^^  ^  0. 
Since,  by  a  result  in  real  analysis  (Rudin  1964),  every  convergent  subsequence  of  {5^} 
converges  to  5,  it  follows  that  5=0.    This  completes  the  proof.  ■ 
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Theorem  5.3.1  guarantees  that,  as  q  grows  large,  the  diameters  of  the  (p-1)- 

simplices  in  the  current  partition  of  S"  get  arbitrarily  small.    Therefore,  in  the  Method 

of  Successive  Bisection,  as  q  becomes  large,  SS"  begins  to  cover  all  of  S". 

5.4.   Examples 

In  this  section,  in  order  to  gain  some  preliminary  insights  into  the  properties  of 
the  Shooting  Algorithm,  we  apply  it  to  three  examples.  In  the  first  two  examples,  the 
algorithm  is  applied  twice,  once  using  the  Method  of  Random  Weights  to  generate  SS*^, 
and  once  using  the  Method  of  Successive  Bisection  to  generate  this  set.  In  the  last 
example,  the  Shooting  Algorithm  is  applied  four  times.  In  this  example,  each  method 
for  obtaining  SS''  is  employed  twice,  each  time  with  a  different  number  of  points  in  SS°. 
The  number  of  points  in  SS*^  is  determined  arbitrarily. 

The  example  problems  are  all  multiple  objective  linear  programs.  Therefore,  the 
mathematical  programming  problems  called  for  in  the  Shooting  Algorithm  are  linear 
programs.    We  employ  the  simplex  method  to  solve  these  linear  programs. 

The  results  of  these  test  runs  will  be  presented  in  tabular  form.  We  will  also  give 
graphs  of  Y,  Y^,  and  RY^  for  each  problem.  For  each  run,  we  will  report  the  number 
of  feasible  problems  (Pj).  We  will  also  report  the  number  of  problems  (Pj)  with  an 
optimal  solution  a*=0.  For  these  problems,  the  only  feasible  solution  is  a=0.  In  that 
respect,  they  are  "pseudo-infeasible"  since  all  such  problems  yield  y'=v°  in  Step  2.2  of 
the  Shooting  Algorithm. 

To  help  quantify  the  quality  of  each  representation  RY^,  we  will  employ  a  ranking 
scheme  based  on  the  coverage  provided  by  RY^  and  the  existence  of  clustering  in  RY^. 
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Although  this  ranking  is  not  precise,  it  may  help  to  convey  some  information  about  the 

quality  of  the  representations  obtained  by  the  Shooting  Algorithm.    The  following  list 
defines  the  ranking  scheme. 


Rank 

Coverage 

Clusters 

1 

Good 

Insignificant 

2 

Good 

Significant 

3 

Poor 

Insignificant 

4 

Poor 

Significant 

Notice  that  the  ultimate  representation  should  provide  a  good  coverage  of  the 
efficient  set  with  no  clusters  in  the  representation.  Therefore,  in  the  above  ranking 
scheme,  lower  numbered  ranks  are  superior  to  higher  numbered  ones. 

Example  1. 


vmax 


■ 

X, 

1 

2 

1 

3 

-1 

^2 

1 

4 

Xj 

1 

"x," 

3 

1 

X, 

<, 

4 

0 

_X3_ 

0 

s.t.  2 

1 


A  J  ,     X^,     X^      ^  \J  , 

This  example  is  taken  from  Yu  and  Zeieny  (1975)  (see  also  Ecker,  Hegner  and 
Kouada  1980).  Figure  5.1(a)  displays  Y  and  Yg,  where  Yg  =  CONV{(6,-3,12), 
(6.5,0,8),  (5,1,9)}  U  C0NV{(5,1,9),  (6.5,0,8),  (2,6,2),  (5,4,0)}.  The  results  are 
summarized  in  Table  5.1. 
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Table  5.1.    Summary  of  results  for  Example  1. 


Method  of 

obtaining 

SS" 

ISS*^ 

Number 
of  feasible 
problems 
(Pd) 

Number  of 
problems 
(Pd)  with 
a'=0 

IRYeI 

Display 

Rank 

Random 
Weights 

100 

33 

0 

25 

Figure 
5.1(b) 

1 

Successive 
Bisection 

100 

28 

0 

28 

Figure 

5.1(c) 

1 
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(6,-3,12) 


(a) 


Figure  5.1.      Graphs  of  Y,  Y^,  and  RY3  for  Example  1. 

(a)  Y  and  Ye; 

(b)  RYe  obtained  using  the  Method  of  Random  Weights; 

(c)  RYe  obtained  using  the  Method  of  Successive  Bisection. 
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(b) 


Figure  5.1 --continued 
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(c) 


Figure  5.1 --continued 


Example  2. 


s.t. 


vmax 


1   0  0 

\' 

0    1    0 

X, 

0  0    1 

.\ 
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1 

1 

1 

"x." 

3 

n 

^ 

2 

1 

x^ 

g: 

4 

1 

-1 

0 

^\ 

0 

X. ,    X^,    X,    i*  \J  . 


This  example  is  a  modification  of  Example  1.    In  this  case,  C  =  I3,  and  thus 
Y  =  X.     Graphs  of  Y  and  Y^  are  given  in  Figure  5.2(a).     In  this  example,  Y^  = 
CONV{(0,0,3),  (0.5,0.5,2),  (0,1,2)}  U  CONV{(0,1,2),  (0.5,0.5,2),  (1,1,0),  (0,2,0)}. 
Table  5.2  summarizes  the  results. 
Table  5.2.    Summary  of  results  for  Example  2. 


Method  of 
obtaining 

SS" 

iss^^i 

Number 
of  feasible 
problems 
(Pd) 

Number  of 
problems 
(Pd)  with 
a'=0 

IRYeI 

Display 

Rank 

Random 

Weights 

50 

50 

26 

25 

Figure 
5.2(b) 

2 

Successive 
Bisection 

50 

50 

23 

28 

Figure 
5.2(c) 

1 
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yj 


(0,0,3) 


y2 


yi 


(0,2,0) 


Figure  5.2.      Graphs  of  Y,  Ye,  and  RYg  for  Example  2. 

(a)  Y  and  Ye; 

(b)  RYe  obtained  using  the  Method  of  Random  Weights; 

(c)  RYe  obtained  using  the  Method  of  Successive  Bisection. 
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Figure  5.2~continued 
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(c) 


Figure  5.2--continued 


Example  3. 


s.t. 


vmax 


1  0  0 

X, 

0  1  0 

"h 

0  0  1 

_\ 

6  15  10" 

"210" 

5  8  12 

X, 

152 

22  29  28 

x. 

^ 

458 

24  16  11 
1  0  4 

\ 

312 
40 

8  0   1 

72 

A,  ,    X^,    X,     :r  U . 
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This  example  is  taken  form  Dessouky,  Ghiassi  and  Davis  (1986).  Since  C  =  I3 
in  this  problem,  Y  =  X.  Yg  is  the  union  of  four  efficient  faces,  each  of  dimension  two, 
and  is  given  by  CONV{(0,4,10),  (8,2,8),  (0,10,6)}  U  CONV{(8,2,8),  (5,12,0), 
(0,10,6)}  U  CONV{(8,2,8),  (9,6,0),  (5,12,0)}  U  CONV{(0,10,6),  (5,12,0),  (0,14,0)}. 
Graphs  of  Y  and  Y^  are  displayed  in  Figure  5.3(a).  The  results  for  this  example  are 
summarized  in  Table  5.3. 
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(0,4,10) 


(0,10,6; 


(5,12,0) 


(a) 


Figure  5.3.      Graphs  of  Y,  Ye,  and  RY^  for  Example  3. 


(a)  Y  and  Y^; 

(b)  RYe  obtained  using  the  Method  of  Random  Weights  (ISS'"]  =30); 

(c)  RYe  obtained  using  the  Method  of  Successive  Bisection  ( |  SS°|  =30); 

(d)  RYe  obtained  using  the  Method  of  Random  Weights  (ISS*"]  =50); 

(e)  RYe  obtained  using  the  Method  of  Successive  Bisection  ( |  SS"!  =50); 
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(b) 


Figure  5.3--continued 
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(c) 


Figure  5.3--continued 
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(d) 


Figure  5.3— continued 
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(e) 


Figure  5.3-continued 
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Table  5.3.    Summary  of  results  for  Example  3. 


Method  of 

obtaining 

SS' 

|SS"| 

Number 
of  feasible 
problems 
(Pd) 

Number  of 
problems 
(Pd)  with 

Ct'  =  0 

IRYeI 

Display 

Rank 

Random 

Weights 

30 

30 

0 

30 

Figure 
5.3(b) 

4 

Successive 
Bisection 

30 

30 

0 

30 

Figure 
5.3(c) 

1 

Random 
Weights 

50 

50 

0 

50 

Figure 
5.3(d) 

2 

Successive 
Bisection 

50 

50 

0 

50 

Figure 
5.3(e) 

1 

On  the  basis  of  these  three  examples,  there  are  three  preliminary  observations  that 
we  can  make  regarding  the  Shooting  Algorithm. 

1)  At  least  two  types  of  computational  inefficiency  may  arise  which  involve  SS'^ 
and  the  problem  (PJ. 

First,  for  a  given  point  d  in  SS",  problem  (PJ  may  be  infeasible.  In  this  case, 
no  efficient  point  is  generated  using  this  particular  d.  Generating  such  a  point  d  for 
inclusion  in  SS°  is  thus  clearly  inefficient. 

Second,  for  a  given  point  d  in  SS",  the  optimal  solution  a'  in  problem  (Pj)  may 
be  equal  to  zero.  For  all  such  points  in  SS**,  y'  =  v''  in  Step  2.2  of  the  Shooting 
Algorithm.  Hence,  all  such  points  yield  the  same  efficient  point.  This  "redundancy"  is 
also  clearly  computationally  inefficient. 

2)  The  method  used  to  obtain  SS"  appears  to  have  an  effect  on  the  quality  of  the 
representation  obtained.     For  instance,  in  the  three  examples,  using  the  Method  of 
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Successive  Bisection  in  the  Shooting  Algorithm  generally  seemed  to  yield  a  better 

representation  of  Y^  than  the  method  of  Random  Weights,  and  with  less  clustering. 

3)  The  structure  of  the  problem  seems  to  play  an  important  role  in  the  quality 
of  the  resulting  representation  obtained  using  the  Shooting  Algorithm.  In  particular,  the 
geometry  of  Y  may  have  an  effect  on  the  number  of  infeasible  problems  (Pj)  and  on  the 
number  of  problems  (P^)  with  an  optimal  solution  a*=0.  An  illustration  of  the  effect  of 
the  geometry  of  Y  on  the  results  of  the  Shooting  Algorithm  is  given  by  a  comparative 
evaluation  of  Examples  1  and  2.  Here,  the  differences  in  the  geometry  of  Y  are  due 
solely  to  differences  in  the  objective  function  coefficient  matrix  C.  It  can  be  noted  that 
in  Example  1 ,  for  both  of  the  methods  for  obtaining  SS°,  approximately  one-third  of  the 
points  in  SS°  yield  feasible  problems  (PJ,  and  there  are  no  points  in  SS°  that  have  an 
optimal  solution  a'=0  in  problem  (PJ.  In  Example  2,  for  both  of  the  methods  for 
obtaining  SS",  all  of  the  points  in  SS"  yield  feasible  problems  (PJ.  However, 
approximately  half  of  these  problems  have  an  optimal  solution  a*=0. 

5.5.    Discussion 

In  this  chapter,  we  presented  an  algorithm  for  finding  a  discrete  representation  of 
Ye-   The  algorithm  differs  from  existing  methods  in  at  least  five  ways. 

1)  The  Shooting  Algorithm  takes  a  global  approach  rather  than  a  local  one  as 
employed  by  most  of  the  other  procedures  for  solving  problem  (MMP),  or  special  cases 
of  problem  (MMP). 
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2)  The  algorithm  applies  when  the  feasible  region  is  compact,  convex,  and  the 

objective  functions  are  linear.  In  this  respect,  it  is  a  more  general  procedure  than  usually 
provided  for  problem  (MMP). 

3)  The  goal  of  the  Shooting  Algorithm  is  to  find  a  discrete  representation  of  Yg. 
The  algorithm  does  not  try  to  obtain  the  entire  efficient  set.  Therefore,  it  is  easier  to 
implement  it  and  to  present  the  results  to  the  DM  than  it  is,  for  instance,  when  using 
linear  vector  maximization  algorithms  that  suggest  obtaining  the  entire  efficient  set. 

It  has  been  noted  that  the  set  of  efficient  extreme  points  of  problem  (MOLP)  may 
not  be  representative  of  the  efficient  set  (cf.  Section  1.3  and  2.3.2.2),  because  it  may  not 
provide  good  coverage  and  may  contain  clusters.  Therefore,  the  Shooting  Algorithm 
does  not  attempt  to  find  all  of  the  efficient  extreme  point  solutions  when  applied  to 
problem  (MOLP). 

4)  By  solving  problem  (MOCP)  in  the  objective  function  space,  the  Shooting 
Algorithm  reduces  computational  effort,  reduces  the  risk  of  redundancy  among  the 
efficient  solutions  in  RYg,  and  concentrates  on  what  is  most  relevant  to  the  DM.  It  has 
been  noted  that  the  size  and  dimension  of  the  efficient  set  in  objective  function  space  is 
usually  smaller  than  in  decision  space  (Dauer  1987,  Dauer  1990).  This  is  mainly  due 
to  the  fact  that  the  number  of  objective  functions  in  problem  (MOCP)  is  usually  less  than 
the  number  of  variables.  Also  many  efficient  solutions  of  problem  (MOCP)  may  be 
mapped  into  a  single  efficient  solution  of  problem  (MOCPY).  Since  the  outcomes  are 
usually  more  crucial  to  the  DM  than  the  alternatives  themselves,  the  Shooting  Algorithm 
takes  advantage  of  this  fact  by  solving  the  problem  in  objective  function  space. 
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5)  The  Shooting  Algorithm  can  be  applied  to  problem  (MOLP).  In  that  case,  the 

problems  that  are  solved  during  the  execution  of  the  algorithm  become  linear  programs. 
Hence,  the  algorithm  can  be  implemented  for  problem  (MOLP)  using  standard  linear 
programming  procedures.  However,  when  the  Shooting  Algorithm  is  applied  to  problem 
(MOLP),  it  differs  from  existing  procedures  for  solving  the  same  problem.  Most  of  the 
classical  procedures  for  solving  problem  (MOLP)  rely  on  simplex-type  pivoting 
operations.  They  also  require  complex  book-keeping  schemes.  Furthermore,  the 
presence  of  degeneracy  usually  makes  these  procedure  more  cumbersome.  The  global 
approach  of  the  algorithm  avoids  these  impractical  aspects  associated  with  the  classical 
algorithms  proposed  for  solving  problem  (MOLP). 

Although  our  experimentation  with  the  Shooting  Algorithm  has  been  limited,  the 
examples  we  have  studied  suggest  that  representations  of  reasonable  quality  can  be 
obtained  using  the  algorithm.  The  examples  we  have  studied  also  point  to  some 
directions  for  further  research. 

1)  An  important  issue  concerning  the  implementation  of  the  Shooting  Algorithm 
is  the  redundancy  of  the  points  in  SS".  Some  of  the  points  in  SS''  become  redundant  in 
the  Shooting  Algorithm  because  they  either  yield  infeasible  problems  (PJ,  or  generate 
the  same  efficient  point  as  some  other  points  in  SS".  A  significant  special  instance  of  the 
latter  case  occurs  when  a'=0  in  problem  (PJ  for  a  group  of  points  in  SS°.  Such 
redundancies  are  clearly  computationally  inefficient. 

One  possible  way  of  avoiding  the  points  that  yield  infeasible  problems  (P^)  is 
through  the  use  of  the  set  D  that  we  have  defined  in  Section  5.2.   Since  we  have  shown 
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that  D  is  a  convex  set  of  dimension  (p-1),  it  is  possible  to  obtain  an  inner  approximation 

of  D  as  follows.  Given  a  point  d  in  D,  univariate  searches  along  the  directions  starting 
from  d  towards  some  predetermined  points  on  the  boundary  of  S°  could  be  performed  to 
find  the  elements  of  D  that  are  of  maximum  distance  from  d.  The  convex  hull  of  the 
elements  of  D  thus  obtained  provides  an  inner  approximation  of  D  that  is  a  jwlytope. 
Then,  by  constructing  SS**  from  the  elements  of  D,  infeasible  problems  (PJ  are  avoided. 
Recalling  that  the  elements  of  SS°  that  yield  an  optimal  solution  a*=0  in  problem 
(Pd)  are  not  desirable  since  they  cause  redundancy,  redefining  the  set  D  so  as  to  exclude 
such  points  may  be  an  attractive  alternative.  However,  whether  the  set  D  continues  to 
have  certain  properties  that  can  be  exploited  after  such  a  modification  is  employed  needs 
to  be  studied. 

2)  As  far  as  the  quality  of  the  representation  is  concerned,  clustering  of  the 
efficient  points  in  RYg  is  an  important  problem.  On  the  basis  of  the  examples  we  have 
solved,  it  seems  that  the  method  of  Random  Weights  tends  to  be  more  prone  to 
generating  clusters  in  RY^  than  does  the  Method  of  Successive  Bisection.  However, 
more  experimentation  is  necessary  to  see  if  this  observation  is  valid  in  general. 

3)  Apart  from  developing  schemes  to  generate  SS",  another  possible  variation  of 
the  Shooting  Algorithm  can  be  obtained  by  modifying  Step  2.3.  In  the  current  statement 
of  the  Shooting  Algorithm,  the  elements  of  RY^  are  obtained  by  solving  problem  (Pyx) 
with  X=e,  where  y=y'  is  obtained  by  solving  problem  (P^)  using  the  elements  of  SS". 
An  alternative  that  can  be  studied  would  involve  using  different  weights  X  in  problem 
(Py  x)  for  a  given  y.    In  this  way,  one  y  can  be  used  to  yield  several  efficient  points. 
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However,   this  alternative  needs  to  be  explored  computationally  to  see  if  such  a 

modification  improves  the  quality  of  the  resulting  representations. 

Finally,  a  future  task  to  be  undertaken  is  to  implement  the  Shooting  Algorithm 

when  the  feasible  region  is  a  convex  set  that  is  not  polyhedral.   When  X  is  a  convex  set, 

the  problems  (P^)  and  (Py  J  called  for  in  the  algorithm  become  convex  programs. 

Employing  univariate  search  techniques  for  solving  problem  (PJ  is  an  alternative  to  be 

explored.    The  behavior  of  the  algorithm  for  this  more  general  case  also  needs  to  be 

studied  computationally. 


CHAPTER  6 
CONCLUSION  AND  TOPICS  FOR  FURTHER  RESEARCH 

Among  the  three  categories  of  approaches  for  solving  problem  (MMP),  most  of 
the  recent  work  has  concentrated  on  approaches  that  use  progressive  or  posterior 
articulation  of  the  DM's  preferences.  Although  certain  factors  make  progressive  and 
posterior  approaches  favorable,  these  approaches  have  various  disadvantages  (cf.  Section 
1.2  and  Section  1.3).  Thus,  neither  one  is  fully  adequate  as  a  means  for  solving  problem 
(MMP). 

In  this  dissertation,  we  concentrated  on  the  problem  of  finding  a  discrete 
representation  of  the  efficient  set  of  problem  (MMP).  The  efficient  set  generally  contains 
a  continuum  of  points  and  is  nonconvex.  Therefore,  finding  and  representing  the 
efficient  set  is  a  difficult  problem.  A  good  representation  of  the  efficient  set  should  have 
certain  properties.  First,  the  representation  should  contain  a  sufficiently-large  number 
of  points  to  characterize  the  efficient  set  without  overwhelming  the  DM.  Second,  the 
points  in  the  representation  should  portray  the  efficient  set  so  that  the  DM's  most 
preferred  solution  in  the  representative  set  would  be  sufficiently  close  to  his/her  most 
preferred  solution  over  the  entire  efficient  set.  Finally,  the  computational  requirements 
for  obtaining  the  representative  set  should  not  be  overbearing. 

Solving  the  problem  of  optimizing  a  linear  function  over  the  efficient  set  of  a 
multiple  objective  linear  program      (problem   (P))  may  contribute  to  finding  such 
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representations  of  the  efficient  set.   Problem  (P)  can  be  specialized  to  find  the  minimum 

criterion  values  over  the  efficient  set.     This  information,  along  with  the  maximum 

criterion  values,  constitutes  a  representation  of  the  efficient  set.    However,  rather  than 

providing  a  good  description  of  the  efficient  set,  the  set  of  minimum  and  maximum 

criterion  values  renders  a  very  sparse  representation  that  describes  only  the  limits  of  the 

efficient  set.    Nevertheless,  this  representation  may  be  of  significant  value  for  certain 

interactive  procedures  that  have  been  proposed  to  solve  problem  (MOLP). 

In  Chapter  3,  we  presented  our  studies  towards  an  exact  algorithm  for  solving 
problem  (P).  Our  studies  are  motivated  by  the  bisection-extreme  point  search  algorithm 
of  Benson  (1991c)  for  solving  problem  (PD).  This  algorithm  requires  repeatedly  solving 
concave  minimization  problems.  We  presented  a  finite  branch  and  bound  algorithm  with 
a  neighbor  generation  scheme  for  minimizing  a  concave  function  over  a  polyhedron  and 
reported  some  preliminary  computational  results. 

A  topic  for  further  investigation  is  to  conduct  more  computational  experiments 
using  the  branch  and  bound  algorithm.  To  evaluate  its  performance,  the  algorithm  may 
also  be  compared  to  existing  algorithms  developed  for  solving  the  same  problem. 

Our  preliminary  computational  experiments  with  the  branch  and  bound  algorithm 
suggest  that  the  lower  bounds  obtained  throughout  the  implementation  of  the  algorithm 
may  be  low.  Since  this  hinders  the  performance  of  the  algorithm,  the  question  of 
obtaining  higher  lower  bounds  constitutes  a  topic  for  further  study. 

In  Chapter  4,  we  studied  four  special  cases  of  problem  (P).  Since  problem  (P) 
is  a  difficult  global  optimization  problem,  identifying  special  instances  of  problem  (P)  is 
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worthwhile.    We  provided  detection  and  solution  procedures  for  the  four  special  cases 

that  we  studied.  We  also  gave  a  face  search  heuristic  algorithm  for  solving  the  general 
instance  of  problem  (P).  The  heuristic  algorithm  samples  among  the  efficient  faces  of 
the  feasible  region  and  optimizes  the  objective  function  over  each  efficient  face  that  is 
found. 

The  face  search  heuristic  algorithm  requires  determination  of  sample  sets  from 
Y- and  A.  We  gave  procedures  for  determining  these  sample  sets.  Our  procedures  are 
simple  and  easy  to  implement.  However,  a  useful  topic  to  explore  is  the  question  of 
developing  alternative  procedures  for  constructing  the  sample  sets.  For  instance,  the 
Method  of  Successive  Bisection  presented  in  Chapter  5  may  be  modified  to  generate  a 
sample  of  points  from  Y.  Such  alternate  procedures  have  the  potential  of  improving  the 
speed  and  accuracy  of  the  face  search  heuristic  algorithm.  The  precise  effect  of  the 
composition  of  the  sample  sets  on  the  performance  of  the  face  search  heuristic  algorithm 
also  needs  to  be  explored  computationally. 

Another  potential  means  of  improving  the  accuracy  of  the  face  search  heuristic 
algorithm  is  by  identifying  the  maximally  efficient  faces  that  contain  the  efficient  points 
that  are  encountered  during  the  search  process.  However,  there  are  no  readily-available 
procedures  that  can  be  employed  to  perform  this  task.  Therefore,  this  prompts  a 
question  for  further  research. 

The  problem  studied  in  Chapter  5  is  problem  (MOCP),  the  multiple  objective 
convex  programming  problem.  We  introduced  a  new  global  approach  for  finding  a 
discrete  representation  of  the  efficient  set  that  does  not  necessarily  contain  extreme 
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points.  We  then  presented  an  algorithm  to  implement  this  approach  called  the  "Shooting 

Algorithm."  An  important  component  of  the  Shooting  Algorithm  involves  obtaining  a 
sample  of  points  from  a  simplex.  We  presented  two  methods  for  obtaining  this  sample 
set.  One  of  these  procedures,  the  Method  of  Random  Weights,  is  probabilistic  in  nature, 
and  the  other  one,  the  Method  of  Successive  Bisection,  is  deterministic.  We  applied  the 
Shooting  Algorithm  to  three  examples  of  problem  (MOLP).  For  each  example,  we 
employed  both  the  Method  of  Random  Weights  and  the  Method  of  Successive  Bisection 
to  generate  the  sample  of  points  called  for  in  the  Shooting  Algorithm.  Our  development 
and  experimentation  with  the  Shooting  Algorithm  suggests  many  directions  for  further 
research. 

1)  Ouantifying  the  quality  of  representations  of  Yp.  The  Shooting  Algorithm 
generates  representations  of  Yg.  In  the  examples  that  we  have  studied,  we  discussed  the 
quality  of  the  representations  obtained  on  the  basis  of  some  factors  such  as  coverage  and 
existence  of  clusters.  However,  given  a  set  Z,  and  a  discrete  representation  RZ  of  Z, 
to  develop  measures  for  assessing  the  quality  of  RZ  in  terms  of  representing  Z  poses  a 
general  question  for  future  research.  Quantifying  the  quality  of  a  discrete  representation 
would  enable  us  identify  "good"  representations  of  Y^  provided  that  the  measure  can  be 
applied  in  practice.  In  particular,  the  measure  of  quality  can  be  used  to  compare  various 
representations  obtained  using  the  Shooting  Algorithm.  This  would  help  ranking  certain 
variations  of  the  algorithm  in  terms  of  performance,  and  comparing  them  to  some  of  the 
existing  algorithms.  This,  in  turn,  may  assist  in  setting  goals  for  the  improvement  of  the 
Shooting  Algorithm.   Thus,  finding  an  appropriate  and  practical  way  of  quantifying  the 
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quality  of  a  representation  is  an  important  topic  for  further  research. 

2)  Avoiding  the  redundancy  of  points  in  SS°.  An  important  implementation  issue 
is  the  redundancy  of  the  points  in  SS°  constructed  at  the  beginning  of  the  Shooting 
Algorithm.  Two  evident  classes  of  redundant  elements  of  SS"  are  the  ones  that  yield 
infeasible  problems  (PJ,  and  the  ones  that  have  an  optimal  solution  a'=0  in  problem 

(Pd). 

We  have  defined,  and  studied  certain  properties  of  the  subset  D  of  S°  that  consists 
of  points  yielding  feasible  problems  (PJ.  Although  an  explicit  description  of  D  may  not 
be  readily  available,  based  on  these  properties,  it  is  possible  to  state  a  method  for 
obtaining  an  inner  approximation  of  D  that  is  a  p)olytope.  Once  an  inner  approximation 
of  D  is  constructed,  SS"^  may  be  generated  from  the  elements  of  D.  Thus  infeasible 
problems  (PJ  are  avoided.  It  requires  further  experimentation  to  see  whether  or  not 
finding  such  an  approximation  is  worth  the  computational  burden  it  causes. 

The  elements  of  SS^'  that  have  an  optimal  solution  a*=0  in  problem  (PJ  are  also 
computationally  undesirable.  One  potential  way  of  avoiding  this  computational 
inefficiency  is  by  redefining  D  so  as  to  exclude  such  points.  However,  whether  D 
continues  to  have  certain  properties  that  can  be  exploited  after  such  a  modification  is 
employed  needs  to  be  studied. 

3)  Improving  the  quality  of  the  representations.  The  quality  of  the  representations 
obtained  using  the  Shooting  Algorithm  shows  a  certain  variability  among  the  examples 
we  have  solved.  This  leads  to  the  conjecture  that  the  structure  of  the  problem  is  an 
important  factor  affecting  the  quality  of  the  resulting  representations.    In  particular,  it 
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would  be  useful  to  study  the  causes  of  clustering  and  redundancy  of  the  points  in  the 

representations.  The  affects  of  the  problem  structure  on  the  quality  of  the  representation 

obtained  can  also  be  investigated  via  computational  experimentation.    This  may  lead  to 

developing  methods  for  obtaining  better  representations  of  Y^.    For  instance,  it  may  be 

possible  to  develop  alternative  methods  for  generating  SS"  for  different  problem 

structures  in  a  way  to  ensure  improved  quality  of  representations. 

4)  Generating  alternative  efficient  points.  In  the  Shooting  Algorithm,  problem 
(Py  x)  is  repeatedly  solved  for  various  values  of  y  with  X=e.  Solving  problem  (Py  J 
generates  an  efficient  solution  of  the  problem.  The  Shooting  Algorithm  may  easily  be 
modified  so  that,  for  a  given  y  in  Y,  problem  (Py  0  would  be  solved  for  various  different 
values  of  X  other  than  e.  Thus,  multiple  efficient  points  would  be  generated  using  a 
single  point  y.  This  may  be  helpful  in  improving  the  quality  of  the  resulting 
representations. 

5)  Comparing  methods  for  generating  SS".  On  the  basis  of  the  three  examples 
we  have  solved,  the  Method  of  Successive  Bisection  seems  to  yield  better  representations 
than  the  Method  of  Random  Weights.  To  see  if  this  is  valid  in  general,  or  if  it  is  true 
for  certain  subclasses  of  problems  with  certain  structures,  further  computational 
experimentation  is  necessary.  Furthermore,  alternative  methods  for  generating  SS"  may 
be  developed  and  compared  to  the  two  methods  we  have  presented  via  computational 
experiments  (cf.(2)). 

6)  Implementing  the  Shooting  Algorithm  for  the  general  case.  Although  we 
restricted  our  attention  to  the  linear  case  in  the  examples  that  we  have  studied,  the 
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Shooting  Algorithm  is  applicable  to  cases  where  X  is  any  convex  compact  set  with  a 

nonempty  interior.  Thus,  it  would  be  useful  to  implement  and  test  the  algorithm  for  the 
convex  case. 

When  X  is  a  convex  set,  the  mathematical  programming  problems  called  for  in 
the  Shooting  Algorithm  become  convex  programs.  Studying  the  structure  of  these 
convex  programs  may  lead  to  efficient  procedures  for  their  solution.  For  instance, 
univariate  search  techniques  may  be  employed  to  solve  problem  (PJ.  However, 
computational  experiments  need  to  be  conducted  to  study  the  practicality  of  such  an 
approach. 

7)  Customizing  the  shooting  idea  to  the  linear  case.  It  may  be  possible  to  devise 
special  procedures  for  finding  discrete  representations  of  the  efficient  set  in  problem 
(MOLP).  An  idea  for  such  a  procedure  that  may  be  worth  exploring  is  as  follows. 
Since  the  efficient  set  of  problem  (MOLP)  can  be  expressed  as  a  finite  union  of  its 
efficient  faces,  an  iterative  three-step  procedure  may  be  employed.  First,  the  shooting 
idea  is  used  to  find  a  point  y  in  Y^.  Second,  the  idea  of  the  face  search  heuristic 
algorithm,  for  instance,  can  be  applied  to  identify  an  efficient  face  that  contains  y. 
Third,  a  representation  of  the  efficient  face  identified  in  the  second  step  is  obtained.  If 
a  method  for  finding  representations  of  individual  faces  can  be  formulated,  then  the 
collection  of  efficient  points  obtained  by  employing  the  above  procedure  an  appropriate 
number  of  times  would  constitute  a  representation  of  the  efficient  set. 

8)  Applying  the  Shooting  Algorithm  to  a  real  problem.  To  test  the  practicality 
of  the  Shooting  Algorithm,  it  can  be  applied  to  a  real  problem  with  an  expert  DM  to 
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obtain  a  representation  RYg  of  Yg.  After  studying  the  points  in  RY^,  the  DM  can  choose 

his/her  most  preferred  outcome  among  the  solutions  in  RY^.   Then,  a  pre-image  of  this 

most  preferred  outcome  can  be  obtained  as  a  most  preferred  solution.    The  reaction  of 

the  DM  to  the  representation,  and  thus  to  the  most  preferred  solution  obtained  using  the 

Shooting  Algorithm  constitutes  a  valuable  assessment  of  its  practicality.    Furthermore, 

by  incorporating  the  DM  in  the  process,  the  Shooting  Algorithm  may  be  compared  to 

some  interactive  algorithms  designed  to  address  the  same  problem.     Some  popular 

interactive  algorithms  are  given  by  Steuer  and  Choo  (1983),  Korhonen  and  Wallenius 

(1988),  and  Zionts  and  Wallenius  (1976)  (references  to  other  interactive  algorithms  can 

be  found  in  Shin  and  Ravindran  1991). 

9)  Using  the  Shooting  Algorithm  interactively.  The  Shooting  Algorithm  seems 
to  be  amenable  to  interactive  use.  An  idea  for  such  use  is  as  follows.  First,  a  trial 
representation  RY^  of  the  efficient  set  is  generated  using  the  Shooting  Algorithm  as  stated 
in  Section  5.3.1.  Then,  the  DM  is  asked  to  identify  his/her  most  preferred  solution 
among  the  solutions  in  RY^.  This  constitutes  the  trial  solution  for  the  problem.  Based 
on  the  response  of  the  DM,  new  efficient  solutions  that  are  close  to  the  trial  solution  are 
generated,  and  the  new  representation  is  presented  to  the  DM.  The  procedure  terminates 
when  the  DM  is  satisfied  with  the  trial  solution  and  identifies  it  as  the  most  preferred 
solution. 

To  see  if  the  above  idea  can  be  implemented  in  a  practical  way  constitutes  a  topic 
for  further  research.  If  interactive  use  of  the  shooting  idea  proves  to  be  a  practical 
approach  for  solving  problem  (MOCP),  it  would  be  worthwhile  to  explore  the  properties 
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of  the  resulting  interactive  algorithm  and  to  compare  it  to  other  existing  interactive 

methods.    Computational  experiments  and  applying  the  interactive  idea  to  real  world 
problems  may  be  helpful  in  determining  its  practicality. 

10)  Modifying  the  shooting  idea  to  solve  discrete  multiple  objective  mathematical 
programming  problems.  The  shooting  idea  and  thus  the  Shooting  Algorithm  we  have 
presented  assume  that  X  is  a  convex  set.  To  see  if  the  shooting  idea  can  be  implemented 
when  X  is  a  discrete  set  is  a  question  for  future  research. 

11)  Using  artificial  intelligence  techniques  for  finding  discrete  representations  of 
the  efficient  set.  The  main  purpose  in  finding  discrete  representations  of  the  efficient  set 
in  multiple  objective  mathematical  programming  is  to  help  the  DM  learn  about  the 
efficient  set.  The  problem  of  learning  about  "concepts"  has  been  studied  extensively  in 
the  area  of  artificial  intelligence.  To  see  if  the  learning  ideas  can  be  adapted  to  generate 
discrete  representations  of  the  efficient  set  poses  a  problem  worth  exploring  as  further 
research. 
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CONCAVE  MINIMIZATION  TEST  PROBLEMS,  SOLUTIONS 
AND  COMPUTATIONAL  RESULTS 

Let  f,(x):R"  -*  R,  i  =  l,..,6,  be  defined  as  in  Table  3.L    Let 
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Then  the  concave  minimization  test  problems  are  defined  as  follows. 
4x5  Problems 

s.t.        A|X  <  b,,  X  >  0. 


s.t.        A,x  <  b,,  X  >  0. 


s.t.  A,x  <  b,,  X  >  0. 
s.t.  A,x  <  b,,  X  >  0. 
s.t.        A,x  <  b,,  X  >  0, 


PI: 

Min  f, 

P2: 

Min  fj 

P3: 

Min  t; 

P4: 

Min  t; 

P5: 

Min  f4 

P6: 

Min  f, 

s.t.        A,x  <  b,,  X  >  0. 


(K  =  2  in  Q. 
(K  =  3  in  fj. 


173 

P7:  Min  f^  s.t.  A.x  <  b,,  x  >  0,      (K  =  8  in  Q. 

P8:  Min  f4  s.t.  A,x  <  b,,  x  >  0,      (K=16  in  f,). 

P9:  Min  f4  s.t.  A,x  <  b,,  x  >  0,      (K=50  in  fj. 

PIO:  Min  f,  -  30x^  -  25x^  -  l,000xs  s.t.  A,x  <  b,,  x  >  0. 

Pll:  Min  f,  -  30x^  -  25x^  -  lOO.OOOx,       s.t.  AjX  <  b,,  x  >  0. 

P12:  Min  f^  -  30x5  -  25xa  -  x,  s.t.  A,x  <  b,.  x  >  0. 

8x6  Problems 

P13:  Min  t\  s.t.  A^x  <  b.,  x  >  0,      (K=4  in  fj. 

P14:  Min  t;  s.t.  A,x  <  b„  x  >  0,       (K-4  in  Q. 

P15:  Min  t4  s.t.  A.x  <  b4,  x  >  0,      (K=20  in  t4). 

PI 6:  Min  f,  -30x^  -25x^  -l.OOOx,  -SOOx^   s.t.  AjX  <  b.,  x  >  0. 

P17:  Min  t\  s.t.  A,  <  b.,  x  >  0. 

P18:  Min  fs -30x^25x^1, 000x,-10,000x,  s.t.        A,x  <  b„  x  >  0. 

P19:  Min  i\  s.t.  A,  <  b,,  x  >  0. 

P20:  Min  f,  -30x^  -25xi  -l.OOOxs  -iO,OOOx,  s.t.        A.x  <  b„  x  >  0. 

P21:  Min  f,  -30x^  -25x^  -l,0(X)x,  -500x,   s.t.  A.x  <  b,,  x  >  0. 

P22:  Min  f,  s.t.  A.  <  b,,  x  >  0. 

P23:  Min  f,  s.t.  A.  <  b„  x  >  0. 

P24:  Min  f^  -30x5  -  25xi  -  UOOOxj  -  10,000x,  s.t.       A.x  <  b4,  x  >  0. 

3x7  Problems 

P25:  Min  f,  s.t.        A3  <  b^,  x  >  0. 

P26:  Min  f,  -30x5  -25x^  -KOOOx,  -3,000x,  -20,000x7       s.t.        A,x  <  b,,,  x>0. 
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P27:  Min  f^  -30x5  -25x^  -l.OOOx.,  -3,000x,  -200x7  s.t.        AjX  <  b„  x>0. 

P28:  Min  fj  s.t.        A,  <  b„  x  >  0. 

P29:  Min  f.  -  lOx,  -  4OX4  s.t.        A3  <  b^,  x  >  0. 

P30:  Min  f.  -  2x,  -  4x4  s.t.        A,  <  b^,  x  >  0. 

P31:  Min  t\  s.t.        A3X  <  b„  x  >  0,      (K=20  in  t\). 

P32:  Min  f4  s.t.        A,x  <  b„  x  >  0,      (K=2  in  Q. 

P33:  Min  t\  s.t.  A3  <  b^,,  x  >  0. 

P34:  Min  f,  s.t.  A,  <  b„  x  >  0. 

P35:  Min  fj  -  40x2  "  50x,  s.t.  A,  <  b„  x  >  0. 

P36:  Min  f,  -  40x,  -  5OX7  s.t.  A,  <  b„  x  >  0. 

3x8  Problem.s 

P37:  Min  f,  s.t.  A4  <  b7,  x  >  0. 

P38:  Min  f,-30x5-25xi-l,OOOx,-3,OOOx,-200x7-10,OOOxK  s.t.  A4X  <  b,,  x>0. 

P39:  Min  f,-30x^25x^l, OOOX5-3OOX,- 100x7- l,000xs  s.t.  A4X  <  b7,  x>0. 

P40:  Min  f,-30x-3-25xi-l, 000x5-1, 0OOx,-2,OO0x7-5OOxh  s.t.  A^x  <  b7,  x>0. 

P41:  Min  f5-30x^25x^  1,000x5- 1,500x,-200x7-2,000xs  s.t.  A4X  <  b7,  x>0. 

P42:  Min  f,  s.t.  A4  <  b7,  x  >  0. 

P43:  Min  f5-3Ox5-25xi-1.0O0x,-2.5O0x,-lOOx.-4.OO0x,  s.t.  A4X  <  b..  x>0. 

P44:  Min  -x^  -  2x5  -  4x5  -  8xi  s.t.  A4  <  b7,  x  >  0. 

P44:  Min  -lOOx^  -  x^  -  lOx^  s.t.  A4  <  b7,  x  >  0. 

P46:  Min  -200x-;  -  lOx,  -  lOOx,  s.t.  A4  <  b7,  x  >  0. 

P47:  Min  f,  -  2OX3  -  IOX7  s.t.  A4  <  b7,  x  >  0. 
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P48:  Min  f.  -  lOx,  -  lOx,  -  x^ 

5x10  Problems 

P49:  Min  fj-30x^25x^l,000x5-l,500x,-4,000xc 

P50:  Min  -50x^  -  lOxj  -  lOOx, 

P51:  Min -50x^  -  40x3  -  40xg 

P52:  Min  tV30x-r25x5-l,OOOx,-500x,-1.000xg 

P53:  Min  -50x^  -  40x3  -  50xi 

P54:  Min  f,  -  lOx^ 

P55:  Min  f.  -  10.4x5 

P56:  Min  f, 

P57:  Min  f,  -  6x3 


P58:     Min  f,  -  \] 


P59:      Min  f,  -  x^ 

P60:     Min  tV30x5-25x^l,OOOx5-2,500x6-6,OOOxg 


s.t.        A4  <  b7,  X  >  0. 


s.t. 

A5X 

< 

K 

x>0 

s.t. 

A5X 

< 

K 

x>0 

s.t. 

A5X 

< 

K 

x>0 

s.t. 

A^x 

< 

K 

x>0 

s.t. 

A5X 

< 

K 

x>0 

s.t. 

A5X 

< 

K 

x>0 

s.t. 

A5X 

< 

K 

x>0 

s.t. 

A5X 

< 

K 

x>0 

s.t. 

A,x 

< 

bs, 

x>0 

s.t. 

A5X 

< 

K 

x>0 

s.t. 

A5X 

< 

b„ 

x>0 

s.t. 

A^x 

< 

K 

x>0 

Solutions 


4x5  Problems  (within  5%  of  optimality) 


PI:  x 

P2:  X 

P3:  X 

P4:  X 


=  (0.341,0.000,0.000,26.588,58.294),  f  =  -547.4 

=  (0.353,0.000,1.000,27.471,56.735),  f  =  -396.9 

=  (0.989,0.000,0.000,75.167,0.000),  f  =  -48,823.4 

=  (0.762,0.497,30.830,58.178,0.000),  f 


-85.0 
P5:       x*  =  (0.989,0.000,0.000,75.167,0.000),     r  =  -11,302.0 
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P6: 

x' 

P7: 

x' 

P8: 

X* 

P9: 

X* 

PIO: 

x' 

Pll: 

x' 

P12: 

X* 

(0.989.0.000,0.000,75.167,0.000),  f  =  -16,953.0 

(0.989,0.000,0.000.75.167,0.000),  f  =  -45,208.0 

(0.989,0.000,0.000,75.167,0.000),  f  =  -90,416.1 

(0.989,0.000,0.000,75.167,0.000),  f  =  -282.550.3 

(0.989,0.000,0.000,75.167,0.000),  f  =  -140,132.8 

(0.000.0.000,0.000,0.000,75.000),  f  =  -7,500,000 

(0.989,0.000,0.000,75.167,0.000),  f  =  -140,132.8 


8x6  Problems  (within  5%  of  optimality) 

=  (0.000,0.000,0.000,54.000.0.000,0.000),  r  =  -11,664.0 

-  (0.000,0.000,0.000,75.000,0.000.0.000),  r  =  -22,500.0 

=  (0.000,0.000,20.000,0.000,0.000,6.923),  f  =  -8,958.6 

=  (0.000,0.000,0.000.54.000,0.000,0.000),  f  =  -72,900.0 

=  (0.000,0.000,19.400,30.400,13.900,0.000),  f  =  -256.7 

=  (0.000,0.000,0.000.0.000.0.000.10.000).  f  =  -100.000.0 

=  (0.000,0.000.13.000,14.000,6.000,6.000),  f  =  -126.0 

=  (0.000,0.000,0.000,72.000,0.000,6.000),  f  =  -189,600 

=  (0.000,0.000,0.000.75.000,0.000,0.000),  f  =  -140,625 

=  (0.000,0.000,30.000,30.000.30.000,0.000),  f  =  -436.0 

=  (0.000.0.000.20.000.0.000.0.635,6.825).  f  =  -63.6 

P24:     x'  =  (0.000,0.000,0.000,0.000,0.000,10.000),  f  =  -100,000 


P13: 

x' 

P14: 

x* 

P15: 

x' 

P16: 

x' 

PI7: 

x' 

P18: 

x' 

P19: 

x' 

P20: 

x* 

P21: 

X* 

P22: 

x' 

P23: 

x' 
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P25: 

x' 

=  ( 

P26: 

X* 

=  ( 

P27: 

X* 

=  ( 

P28: 

x' 

=  ( 

P29: 

X* 

=  ( 

P30: 

x' 

=  ( 

P31: 

X* 

=  ( 

P32: 

x' 

—  ( 

P33: 

X* 

—  ( 

P34: 

X* 

=  ( 

P35: 

X* 

P36: 

x' 

=:    ( 

25.000,0.000,0.000,0.000,0.000,0.000,0.000), 
0.000,0.000,0.000,0.000,0.000,0.000,6.818), 


3x7  Problems  (within  5%  of  optimality) 
(25.000,0.000,0.000,0.000, 
(0.000,0.000,0.000,0.000,0 
(0.000,25.000.0.000,0.000,0.000,0.000,0.000), 
(0.000,0.000,5.603,0.000,0.000,5.388,4.310), 
(21.875,0.000,0.000,1.562,0.000,0.000,0.000), 

16.379,0.000,0.000,1.868,0.000,0.000,2.442), 
^25.000,0.000.0.000,0.000,0.000,0.000,0.000), 
'25.000,0.000,0.000,0.000,0.000,0.000,0.000), 
'25.000,0.000,0.000,0.000,0.000,0.000,0.000), 

>5. 000,0.000,0.000,0. 000,0. 000,0. 000,0.000), 
(0.000,25.000,0.000,0.000,0.000,0.000,0.000), 
(0.000,0.000,0.000,0.000,0.000,12.500,0.000), 


II 

-125.0 

r  = 

-136,363.6 

r  = 

-111,675.0 

r  = 

-79.3 

r  - 

-309.4 

f  = 

-81.2 

r  = 

-12,500.0 

r  = 

-1,250.0 

f  = 

-81.4 

r  = 

-4,024.6 

r  = 

-25,050.0 

f  = 

-6325,0 

3x8  Problems  (witiiin  5%  of  optimality) 

=  (30.000,0.000,0.000,0.000,0.000,0.000,0.000.0.000),  r  =  -164.3 

=  (0.000.26. 154,0.000,0.000,0.000,0.000,0.000,3.846),  f  =  -159,183.7 

=  (30.000,0.000,0.000,0.000,0.000,0.000,0.000.0.000),  f  =  -153,360.0 

=  (30.000,0.000,0.000,0.000,0.000,0.000,0.000,0.000),  r  =  -153,360.0 

=  (30.000,0.000,0.000,0.000,0.000,0.000,0.000,0.000),  f  =  -153,360.0 

=  (0.000,0.000,0.000,0.000,0.000,9.274,4.516,2.419),  f  =  -106.6 

P43:     x*  =  (0.000,30.000,0.000,0.000,0.000,0.000,0.000,0.000),  f  =  -153,360.0 


P37: 

X* 

P38: 

X* 

P39: 

X* 

P40: 

x' 

P41; 

X* 

P42: 

x' 
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P44:     x"  =  (0.000,30.000,0.000,0.000.0.000,0.000,0.000.0.000),         f  =  -1,800.0 

P45:  x*  =  (30.000,0.000,0.000,0.000,0.000,0.000,0.000,0.000),  f  =  -90,000 

P46:  x'  =  (0.000,30.000,0.000,0.000,0.000,0.000,0.000,0.000),  f  =  -180,000 

P47:  x*  =  (0.000,0.000,9.770,0.000,0.000,0.000,5.552.0.000),  f  =  -318.5 

P48:  x*  -  (0.000,0.000,9.770,0.000,0.000,0.000,5.552,0.000),  f  =  -220.8 

5x10  Problems  (within  5%  of  optimality) 

P49:     x*  =  (0.000,0.126,0.000,0.000,0.000,0.000,0.000,0.000,4.811,0.000), 
f  =  -547.4 

P50:     x"  =  (0.000,0.126,0.000,0.000,0.000,0.000,0.000,0.000,4.811,0.000), 

f  =  -396.9 
P51:     x'  =  (0.000,0.000,5.000,0.000,0.000,0.000,0.000,0.000,0.000,0.000), 

r  =  -48,823.4 
P52:     x'  =  (0.000,0.126,0.000,0.000,0.000,0.000,0.000,0.000,4.811,0.000), 

f  =  -85.0 
P53:     x*  =  (0.000,0.000,0.000,3.333,0.000,0.000,0.000,0.000,0.000,0.000), 

r  =  -11,302.0 
P54:     x*  =  (0.000.0.000,5.000.0.000.0.000,0.000.0.000.0.000,0.000,0.000), 

r  =  -16,953.0 
P55:     x'  =  (0.000.0.000.0.000.3.333.0.000.0.000.0.000,0.000.0.000.0.000), 

r  =  -45,208.0 
P56:     x*  =  (1.310,0.223,0.000,0.000,0.000,0.000,1.059,0.000,2.297,0.000), 
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r  =  -90,416.1 
P57:     X*  =  (0.000,0.000,5.000,0.000,0.000,0.000,0.000,0.000,0.000,0.000), 

f  =  -182,550.3 
P58:     x'  -  (1.310,0.223,0.000,0.000,0.000,0.000,1.059,0.000,2.297,0.000), 

f  =  -140,132.8 
P59:     x'  =  (1.062,0.086,0.000,0.000,0.000,0.000,0.000,0.000,3.809,0.000), 

r  =  -7,500,000.0 
P60:     x*  =  (0.000,0.126,0.000,0.000.0.000,0.000,0.000,0.000,4.811,0.000), 

f  =  -140,132.8 


Table  A.l.    Computational  results:  4x5  Problems 

Problem 

Iterations 

Nodes 

Simplex 
Iterations 

Pseudo- 
pivots 

CPU  time 

PI 

0 

1 

8 

5 

1.5672 

P2 

0 

1 

6 

5 

1.5676 

P3 

TO 

73 

145 

120 

2.1804 

P4 

1 

6 

6 

15 

1.6036 

P5 

22 

73 

124 

120 

2.1756 

P6 

22 

73 

141 

120 

2.1759 

P7 

"IT 

73 

148 

120 

2.1886 

P8 

22 

73 

145 

120 

2.1868 

P9 

TO 

73 

145 

120 

2.1808 

PIO 

12 

41 

104 

120 

1.9470 

PU 

0 

1 

7 

5 

1.5719 

P12 

12 

41 

99 

120 

1.9335 
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Table  A. 2.    Computational  results:  8x6  Problems 

Problem 

Iterations 

Nodes 

Simplex 
Iterations 

Pseudo- 
pivots 

CPU  time 

P13 

19 

57 

103 

186 

2.1970 

P14 

20 

58 

112 

198 

2.2069 

P15 

18 

57 

130 

192 

2.1814 

P16 

7 

41 

186 

1.8416 

P17 

1 

5 

14 

18 

1.6137 

P18 

0 

1 

9 

6 

1.5687 

P19 

0 

1 

12 

6 

1.5742 

P20 

8 

24 

32 

198 

2.1369 

P21 

7 

21 

38 

198 

1.8345 

P22 

0 

1 

8 

6 

1.5756 

P23 

0 

1 

7 

6 

1.5752 

P24 

0 

1 

9 

6 

1.5696 

Table  A. 3.    Computational  results:  3x7  Problems 

Problem 

Iterations 

Nodes 

Simplex 
Iterations 

Pseudo- 
pivots 

CPU  time 

P25 

0 

1 

7 

21 

1.5706 

P26 

1 

4 

12 

35 

1.5941 

P27 

0 

7 

1.5681 

P28 

0 

10 

n  1 

1.5844 

P29 

0 

8 

^  1 

1.5732 

P30 

0 

10 

21 

1.5699 

P31 

0 

7 

T  1 

1.5674 

P32 

0 

7 

T  1 

1.5692 

P33 

0 

7 

1  1 

1.5637 

P34 

0 

7 

T  1 

1.5652 

P35 

1 

3 

12 

28 

1.5827 

P36 

3 

8 

27 

42 

1.6254 
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Table  A. 4.    Computational  results:  3x8  Problems 

Problem 

Iterations 

Nodes 

Simplex 
Iterations 

Pseudo- 
pivots 

CPU  time 

P37 

0 

1 

9 

24 

1.5807 

P38 

1 

3 

8 

32 

1.5757 

P39 

0 

1 

10 

24 

1.5751 

P40 

0 

1 

11 

24 

1.4777 

P41 

0 

1 

9 

24 

1.5669 

P42 

1 

5 

11 

40 

1.6104 

P43 

0 

1 

9 

24 

1.5660 

P44 

T 

6 

19 

40 

1.6065 

P45 

0 

1 

9 

24 

1.5689 

P46 

0 

1 

8 

24 

1.5737 

P47 

1 

4 

10 

32 

1.5941 

P48 

1 

4 

10 

32 

1.6006 

Table  A. 5.    Q 

jinputational  re 

suits:  5x10 

Problems 

Problem 

Iterations 

Nodes 

Simplex 
Iterations 

Pseudo- 
pivots 

CPU  time 

P49 

1 

4 

11 

40 

1.5973 

P50 

1 

4 

15 

40 

1.5939 

P51 

27 

94 

102 

1230 

3.8598 

P52 

1 

4 

13 

40 

1.5943 

P53 

T 

6 

19 

50 

1.6219 

P54 

0 

1 

12 

30 

1.5692 

P55 

0 

1 

15 

30 

1.5725 

P56 

0 

1 

12 

30 

1.5824 

P57 

0 

1 

12 

30 

1.5743 

P58 

62 

283 

756 

1230 

6.5772 

P59 

28 

111 

191 

1230 

4.3587 

P60 

1 

4 

13 

40 

1.5950 
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